00000001:02000400:0.0F:1787862032.793808:0:2975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787862053.784825:0:3203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787862056.433549:0:3264:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 563 MB/s 00000001:01000000:2.0:1787862056.683638:0:3264:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 855 MB/s 00000001:01000000:2.0:1787862056.933097:0:3264:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2799 MB/s 00000020:02000000:2.0:1787862058.001082:0:3295:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_120_gb73d7ca 00000400:02000000:2.0:1787862059.389484:0:3311:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.109@tcp [8/256/0/180] 00008000:02000000:3.0F:1787862063.037168:0:3460:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787862125.956515:0:5265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787862139.914656:0:5849:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787862139.914664:0:5849:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787862139.914782:0:5849:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000c0131f0 00000080:02000400:2.0:1787862139.914808:0:5849:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787862139.928324:0:5849:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787862139.928350:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787862139.928530:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009623962b) 00000020:00000080:3.0:1787862139.928568:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787862139.980923:0:5849:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787862139.982907:0:5849:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787862140.000903:0:5849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787862140.000948:0:5849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787862140.000971:0:5849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787862140.001023:0:5849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787862140.001079:0:5849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787862140.001461:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787862140.001470:0:5849:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787862140.001481:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd9802 00000020:01000004:2.0:1787862140.001492:0:5849:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787862140.001498:0:5849:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787862140.001503:0:5849:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c0131f0 from MGS 00000020:01000004:2.0:1787862140.001508:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787862140.001534:0:5849:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000064cc3cc3) 00000020:00000080:2.0:1787862140.001546:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787862140.001731:0:5849:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c0131f0 from MGS, refs=2 00080000:01000000:2.0:1787862140.001738:0:5849:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787862140.001744:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd9810 00000100:00100000:2.0:1787862140.001842:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787862140.001993:0:5849:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787862140.002004:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787862140.002592:0:5849:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787862140.002600:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787862140.003773:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787862140.004615:0:5849:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787862140.004624:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787862140.005644:0:5849:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787862140.005655:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787862140.006413:0:5849:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787862140.006421:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787862140.008677:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862140.008683:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862140.008686:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862140.009440:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862140.009443:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862140.009445:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862140.010713:0:5849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787862140.012272:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787862140.260125:0:5849:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2483 MB/s 00000001:01000000:1.0:1787862140.510974:0:5849:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2011 MB/s 00000001:01000000:0.0:1787862140.762715:0:5849:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 383 MB/s 00000001:01000000:0.0:1787862141.012319:0:5849:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 707 MB/s 00080000:10000000:1.0:1787862141.028719:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787862141.060419:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787862141.066435:0:5849:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787862141.066466:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787862141.066469:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787862141.068467:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787862141.068546:0:5849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787862141.068597:0:5849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787862141.068881:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787862141.068921:0:5849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787862141.070073:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862141.071170:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787862141.071185:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787862141.081196:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787862141.081213:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787862141.086203:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787862141.086219:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787862141.104465:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787862141.104496:0:5849:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.109@tcp' 00000020:01000004:2.0:1787862141.104499:0:5849:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787862141.104562:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.109@tcp (typ=mgc) 00000020:00000080:2.0:1787862141.104589:0:5849:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.109@tcp (0000000093f267b5) 00000020:00000080:2.0:1787862141.104646:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787862141.104763:0:5849:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000051c6d45d@MGC192.168.202.109@tcp: add connection 192.168.202.109@tcp at head 00000100:00080000:3.0:1787862141.106556:0:5864:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1787862141.120427:0:5849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.109@tcp-0 is initialized 00000040:01000000:2.0:1787862141.120444:0:5849:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787862141.123691:0:5865:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787862141.124473:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.109@tcp (uuid 55a8aa20-01eb-4a0c-8ff5-cc227f621b82) 00000020:00000080:2.0:1787862141.124512:0:5849:0:(genops.c:1385:class_connect()) connect: client 55a8aa20-01eb-4a0c-8ff5-cc227f621b82, cookie 0x391a6cd368cd981e 00000100:00080000:2.0:1787862141.124526:0:5849:0:(import.c:510:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862141.124533:0:5849:0:(import.c:624:import_select_connection()) MGC192.168.202.109@tcp: import 0000000051c6d45d using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1787862141.124582:0:5849:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000462bd973 x1874709246378112/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787862141.124621:0:5849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 55a8aa20-01eb-4a0c-8ff5-cc227f621b82->MGS 00000020:01000004:2.0:1787862141.124651:0:5849:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787862141.124668:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787862141.124685:0:5849:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d9ff3f8f) 00000020:00000080:2.0:1787862141.124699:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787862141.125373:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000462bd973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3326:1874709246378112:0@lo:250: 00000100:00100000:3.0:1787862141.125499:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862141.125588:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378112 00000100:00100000:3.0:1787862141.125596:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378112 00000100:00100000:1.0:1787862141.139167:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862141.139181:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd48ff70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3326:x1874709246378112:12345-0@lo:250: 00010000:00080000:1.0:1787862141.139218:0:5862:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 55a8aa20-01eb-4a0c-8ff5-cc227f621b82@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1787862141.139579:0:5862:0:(genops.c:1385:class_connect()) connect: client 55a8aa20-01eb-4a0c-8ff5-cc227f621b82, cookie 0x391a6cd368cd982c 00000100:00080000:1.0:1787862141.140768:0:5862:0:(import.c:65:import_set_state_nolock()) 000000004e4939bb : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862141.140985:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd48ff70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:3326:x1874709246378112:12345-0@lo:250: Request processed in 1800us (15481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862141.141000:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862141.141812:0:3326:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787862141.141830:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1787862141.141841:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787862141.141847:0:3326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787862141.141852:0:3326:0:(import.c:65:import_set_state_nolock()) 0000000051c6d45d MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787862141.141865:0:3326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787862141.141882:0:3326:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787862141.141964:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000462bd973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3326:1874709246378112:0@lo:250: 00000100:00100000:2.0:1787862141.154513:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862141.154944:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862141.154951:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787862141.164220:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787862141.164240:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787862141.164646:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787862141.164652:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787862141.166668:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862141.166922:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787862141.166929:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787862141.170697:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787862141.170714:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787862141.235562:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787862141.235760:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787862141.235767:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787862141.241521:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787862141.241541:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787862141.242469:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862141.242710:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787862141.242717:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787862141.244855:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787862141.244871:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787862141.245647:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862141.245883:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787862141.245888:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787862141.248473:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787862141.248492:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787862141.249434:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862141.249770:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787862141.249777:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787862141.258291:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787862141.258321:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787862141.286312:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862141.286740:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862141.286748:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787862141.292910:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787862141.292929:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787862141.295451:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787862141.295487:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787862141.300745:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787862141.300784:0:5849:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787862141.300795:0:5849:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787862141.300974:0:5849:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787862141.301023:0:5849:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787862141.301029:0:5849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787862141.301031:0:5849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787862141.301070:0:5849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862141.301072:0:5849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862141.301073:0:5849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862141.301075:0:5849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862141.301076:0:5849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787862141.301077:0:5849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787862141.301079:0:5849:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787862141.301080:0:5849:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787862141.301082:0:5849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862141.301083:0:5849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787862141.301086:0:5849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787862141.301088:0:5849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787862141.301089:0:5849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787862141.301090:0:5849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862141.301091:0:5849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862141.301092:0:5849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862141.301093:0:5849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862141.301093:0:5849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787862141.301094:0:5849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787862141.301095:0:5849:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787862141.301096:0:5849:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787862141.301097:0:5849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862141.301098:0:5849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787862141.301134:0:5849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787862141.301159:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000093ded85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378240:0@lo:253: 00000100:00100000:3.0:1787862141.301277:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862141.301337:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c529d949 going to sleep for 11 seconds 00000100:00100000:1.0:1787862141.301476:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378240 00000100:00100000:1.0:1787862141.301485:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378240 00000100:00100000:1.0:1787862141.301568:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862141.301578:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3e9683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5849:x1874709246378240:12345-0@lo:253: 20000000:01000000:1.0:1787862141.301640:0:5863:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787862141.301648:0:5863:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787862141.302009:0:5884:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787862141.302091:0:5863:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787862141.302456:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862141.305899:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787862141.306242:0:5863:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787862141.306251:0:5863:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787862141.306259:0:5863:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787862141.306263:0:5863:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787862141.306281:0:5863:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787862141.306746:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862141.307014:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787862141.307030:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787862141.307125:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787862141.307179:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787862141.307213:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787862141.307324:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787862141.307333:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787862141.307383:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787862141.307402:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787862141.307434:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787862141.307441:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787862141.307473:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787862141.307523:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787862141.307570:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787862141.307575:0:5863:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787862141.307587:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862141.307889:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787862141.307899:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787862141.307933:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787862141.307966:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787862141.308022:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787862141.308036:0:5863:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787862141.308139:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787862141.308158:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787862141.308225:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787862141.308264:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787862141.308299:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787862141.308312:0:5863:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787862141.308484:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787862141.308500:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787862141.308535:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787862141.308706:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787862141.308940:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787862141.308995:0:5863:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787862141.309004:0:5863:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787862141.309991:0:5886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787862141.310418:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787862141.310450:0:5863:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.109@tcp for mdt 20000000:01000000:2.0:1787862141.310452:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:2.0:1787862141.310483:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787862141.310490:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787862141.310514:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787862141.310521:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:2.0:1787862141.310567:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787862141.310577:0:5863:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787862141.310604:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787862141.310631:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787862141.310686:0:5863:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787862141.310690:0:5863:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787862141.310695:0:5863:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787862141.310708:0:5863:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787862141.310711:0:5863:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787862141.310739:0:5863:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787862141.310740:0:5863:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787862141.311132:0:5887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787862141.311404:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787862141.311446:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787862141.311482:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787862141.311495:0:5863:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787862141.311497:0:5863:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787862141.311889:0:5888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787862141.312108:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787862141.312145:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787862141.312219:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787862141.312234:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787862141.312237:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787862141.312246:0:5863:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787862141.312249:0:5863:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787862141.312255:0:5863:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787862141.312262:0:5863:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787862141.312864:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787862141.313186:0:5863:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787862141.327329:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787862141.327414:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787862141.327501:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787862141.327532:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787862141.327573:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327593:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327604:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327630:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327636:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327643:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327648:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098d10870 already unused, calling callback (00000000c2a22531) 00010000:00010000:0.0:1787862141.327652:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327660:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327675:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327682:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.327688:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098d10870/0x391a6cd368cd9833 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787862141.327706:0:5863:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787862141.625602:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3e9683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5849:x1874709246378240:12345-0@lo:253: Request processed in 324012us (324312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862141.625623:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862141.625721:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000093ded85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378240:0@lo:253: 10000000:01000000:1.0:1787862141.625741:0:5849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787862141.625746:0:5849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787862141.625748:0:5849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862141.625749:0:5849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862141.625750:0:5849:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787862141.625751:0:5849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862141.625752:0:5849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862141.625754:0:5849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862141.625755:0:5849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862141.625757:0:5849:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787862141.625760:0:5849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862141.625761:0:5849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787862141.625789:0:5849:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c0131f0 from lustre-MDT0000 10000000:01000000:1.0:1787862141.625823:0:5849:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787862141.625827:0:5849:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787862141.625832:0:5849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89a108763490 10000000:01000000:1.0:1787862141.625837:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862141.625846:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89a108763490 from 1 10000000:01000000:1.0:1787862141.625849:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787862141.625897:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.625908:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.625917:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862141.625937:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378368:0@lo:101: 00000100:00100000:1.0:1787862141.625998:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862141.626261:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095434f8b going to sleep for 11 seconds 00000100:00100000:2.0:1787862141.626371:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378368 00000100:00100000:2.0:1787862141.626379:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378368 00000100:00100000:2.0:1787862141.626471:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862141.626479:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef239c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5849:x1874709246378368:12345-0@lo:101: 00010000:00010000:2.0:1787862141.626497:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862141.626512:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8e65c5c/0x391a6cd368cd9841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd983a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.626533:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8e65c5c/0x391a6cd368cd9841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd983a expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.626542:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8e65c5c/0x391a6cd368cd9841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd983a expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.626551:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8e65c5c, rc 0) 00000100:00100000:2.0:1787862141.626613:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef239c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+6:5849:x1874709246378368:12345-0@lo:101: Request processed in 135us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862141.626620:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862141.626682:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378368:0@lo:101: 00010000:00010000:1.0:1787862141.626694:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.626701:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862141.626757:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378496:0@lo:501: 00000100:00100000:1.0:1787862141.626782:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862141.626846:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095434f8b going to sleep for 11 seconds 00000100:00100000:3.0:1787862141.626919:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378496 00000100:00100000:3.0:1787862141.626924:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378496 00000100:00100000:3.0:1787862141.626944:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862141.626948:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfd084c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+6:5849:x1874709246378496:12345-0@lo:501: 00000100:00100000:3.0:1787862141.627252:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfd084c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+6:5849:x1874709246378496:12345-0@lo:501: Request processed in 303us (469us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862141.627267:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862141.627414:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378496:0@lo:501: 10000000:01000000:1.0:1787862141.627446:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787862141.627464:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.627473:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000c7f81469/0x391a6cd368cd983a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862141.627483:0:5849:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a102b43800 10000000:01000000:1.0:1787862141.627489:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787862141.627494:0:5849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a102b43800 10000000:01000000:1.0:1787862141.627496:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787862141.627499:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89a102b43800 from 1 10000000:01000000:1.0:1787862141.627501:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787862141.627524:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.627539:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.627547:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862141.627559:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378624:0@lo:101: 00000100:00100000:1.0:1787862141.627587:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862141.627607:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095434f8b going to sleep for 11 seconds 00000100:00100000:2.0:1787862141.627736:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378624 00000100:00100000:2.0:1787862141.627741:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378624 00000100:00100000:2.0:1787862141.627764:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787862141.627769:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaff02ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+6:5849:x1874709246378624:12345-0@lo:101: 00010000:00010000:2.0:1787862141.627777:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862141.627796:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053f6d574/0x391a6cd368cd984f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9848 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.627813:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053f6d574/0x391a6cd368cd984f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9848 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.627821:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053f6d574/0x391a6cd368cd984f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9848 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.627827:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053f6d574, rc 0) 00000100:00100000:2.0:1787862141.627906:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaff02ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+7:5849:x1874709246378624:12345-0@lo:101: Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862141.627912:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862141.628257:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378624:0@lo:101: 00010000:00010000:1.0:1787862141.628271:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.628278:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862141.628295:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787862141.628344:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.628351:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000051c87e3/0x391a6cd368cd9848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862141.628358:0:5849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787862141.628433:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862141.628441:0:5849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a102b43800 10000000:01000000:0.0:1787862141.628444:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787862141.628447:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787862141.628455:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862141.628480:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.628487:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862141.628494:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862141.628509:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb49904c pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378752:0@lo:101: 00000100:00100000:0.0:1787862141.628546:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862141.628579:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000259d79bc going to sleep for 11 seconds 00000100:00100000:2.0:1787862141.628634:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378752 00000100:00100000:2.0:1787862141.628639:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378752 00000100:00100000:2.0:1787862141.628676:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787862141.628683:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a31f4014 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+7:5849:x1874709246378752:12345-0@lo:101: 00010000:00010000:2.0:1787862141.628691:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862141.628700:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052f9be68/0x391a6cd368cd985d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9856 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.628715:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052f9be68/0x391a6cd368cd985d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.628721:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052f9be68/0x391a6cd368cd985d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862141.628728:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052f9be68, rc 0) 00000100:00100000:2.0:1787862141.628766:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a31f4014 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+8:5849:x1874709246378752:12345-0@lo:101: Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862141.628784:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862141.628859:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb49904c pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378752:0@lo:101: 00010000:00010000:1.0:1787862141.628869:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862141.628884:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862141.628928:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378880:0@lo:501: 00000100:00100000:1.0:1787862141.628953:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862141.628973:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095434f8b going to sleep for 11 seconds 00000100:00100000:0.0:1787862141.629030:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246378880 00000100:00100000:0.0:1787862141.629199:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246378880 00000100:00100000:0.0:1787862141.629318:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862141.629326:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0f519be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+8:5849:x1874709246378880:12345-0@lo:501: 00000100:00100000:0.0:1787862141.629637:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0f519be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5849:x1874709246378880:12345-0@lo:501: Request processed in 312us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862141.629644:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862141.629760:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246378880:0@lo:501: 00000100:00100000:1.0:1787862141.629800:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379008:0@lo:503: 00000100:00100000:1.0:1787862141.629847:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862141.629918:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095434f8b going to sleep for 11 seconds 00000100:00100000:2.0:1787862141.629972:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379008 00000100:00100000:2.0:1787862141.629978:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379008 00000100:00100000:2.0:1787862141.630001:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862141.630007:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046d70407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5849:x1874709246379008:12345-0@lo:503: 00000100:00100000:2.0:1787862141.630230:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046d70407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5849:x1874709246379008:12345-0@lo:503: Request processed in 223us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862141.630237:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862141.630453:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379008:0@lo:503: 00000100:00100000:3.0:1787862141.630929:0:5891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e2cccc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5891:1874709246379136:0@lo:502: 00000100:00100000:3.0:1787862141.630986:0:5891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862141.631018:0:5891:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fc7afe4 going to sleep for 11 seconds 00000100:00100000:2.0:1787862141.631188:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379136 00000100:00100000:2.0:1787862141.631195:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379136 00000100:00100000:2.0:1787862141.631234:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787862141.631241:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b10ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5891:x1874709246379136:12345-0@lo:502: 00000100:00100000:2.0:1787862141.631462:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b10ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5891:x1874709246379136:12345-0@lo:502: Request processed in 221us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862141.631469:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862141.631564:0:5891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e2cccc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5891:1874709246379136:0@lo:502: 00000020:01000000:1.0:1787862141.631598:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862141.631613:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862141.631615:0:5891:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787862141.631620:0:5891:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787862141.631623:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787862141.631651:0:5891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009bdf2df2) 00000020:00000080:1.0:1787862141.631675:0:5891:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787862141.631682:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787862141.631817:0:5891:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787862141.631825:0:5891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd986b 00000020:00000080:1.0:1787862141.632275:0:5891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787862141.632281:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862141.632285:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862141.632287:0:5891:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787862141.632296:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862141.632300:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862141.632301:0:5891:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787862141.632304:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787862141.632311:0:5891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006041a8ba) 00000020:00000080:1.0:1787862141.632325:0:5891:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787862141.632329:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787862141.632331:0:5891:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787862141.632335:0:5891:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787862141.632343:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787862141.632411:0:5891:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c0131f0 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787862141.632426:0:5891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001371869a) 00000020:00000080:1.0:1787862141.632434:0:5891:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787862141.632493:0:5891:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787862141.632500:0:5891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cd9880 00000020:00000080:1.0:1787862141.632638:0:5891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787862141.632645:0:5891:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787862141.632651:0:5891:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x391a6cd368cd9887 00080000:01000000:1.0:1787862141.632656:0:5891:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787862141.632661:0:5891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd988e 00080000:10000000:1.0:1787862141.633520:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787862141.633759:0:5891:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787862141.640978:0:5891:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787862141.725454:0:5891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787862141.725903:0:5891:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787862141.728899:0:5891:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787862141.729339:0:5891:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787862141.766628:0:5891:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a814f0f3) 00000020:00000080:2.0:1787862141.766663:0:5891:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787862141.766755:0:5891:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787862141.766763:0:5891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd989c 00000020:00000080:3.0:1787862141.767508:0:5891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787862141.772489:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862141.819468:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862141.855873:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862141.918561:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862141.964866:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862142.039471:0:5891:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1787862142.085826:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787862142.121665:0:5891:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x391a6cd368cd98a3 00000020:00000080:1.0:1787862142.122099:0:5891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787862142.122114:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862142.122122:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862142.122124:0:5891:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787862142.122127:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862142.122132:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862142.122140:0:5891:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862142.122144:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862142.122146:0:5891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787862142.122149:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862142.122152:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862142.122153:0:5891:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787862142.122155:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862142.122161:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862142.122162:0:5891:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787862142.122166:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787862142.122223:0:5891:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787862142.122290:0:5891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5891:1874709246379264:0@lo:502: 00000100:00100000:1.0:1787862142.122417:0:5891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.122474:0:5891:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023b3bf2d going to sleep for 11 seconds 00000100:00100000:2.0:1787862142.122654:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379264 00000100:00100000:2.0:1787862142.122668:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379264 00000100:00100000:2.0:1787862142.122720:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787862142.122730:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a07f3e51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5891:x1874709246379264:12345-0@lo:502: 00000100:00100000:2.0:1787862142.123183:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a07f3e51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5891:x1874709246379264:12345-0@lo:502: Request processed in 454us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862142.123193:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787862142.123374:0:5891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5891:1874709246379264:0@lo:502: 00000020:01000000:1.0:1787862142.123421:0:5891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862142.123429:0:5891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862142.123431:0:5891:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787862142.123436:0:5891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787862142.123548:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787862142.123570:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787862142.123593:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.123607:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 0000000098d10870/0x391a6cd368cd9856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862142.123618:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a102b43800 from 1 10000000:01000000:2.0:1787862142.123621:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862142.123661:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.123669:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.123676:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862142.123700:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379392:0@lo:101: 00000100:00100000:2.0:1787862142.123741:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862142.123774:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecfe39eb going to sleep for 11 seconds 00000100:00100000:0.0:1787862142.123825:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379392 00000100:00100000:0.0:1787862142.123833:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379392 00000100:00100000:0.0:1787862142.123869:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862142.123878:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053b4f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:5849:x1874709246379392:12345-0@lo:101: 00010000:00010000:0.0:1787862142.123894:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862142.123911:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd98aa expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.123945:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.123953:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.123958:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f5f0b56, rc 0) 00000100:00100000:0.0:1787862142.123993:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053b4f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:5849:x1874709246379392:12345-0@lo:101: Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862142.124000:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787862142.124017:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379392:0@lo:101: 00010000:00010000:2.0:1787862142.124284:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.124295:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862142.124838:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379520:0@lo:256: 00000100:00100000:2.0:1787862142.124890:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862142.124924:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecfe39eb going to sleep for 11 seconds 00000100:00100000:0.0:1787862142.125469:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379520 00000100:00100000:0.0:1787862142.125479:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379520 00000100:00100000:0.0:1787862142.125533:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862142.125541:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005755c41b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:5849:x1874709246379520:12345-0@lo:256: 20000000:01000000:0.0:1787862142.125568:0:5863:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787862142.125575:0:5863:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787862142.125693:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005755c41b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:5849:x1874709246379520:12345-0@lo:256: Request processed in 152us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862142.125701:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862142.125857:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379520:0@lo:256: 10000000:01000000:2.0:1787862142.126804:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862142.126891:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.126906:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862142.126916:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102b43800 from 1 10000000:01000000:2.0:1787862142.126920:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862142.126967:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.126976:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.126986:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862142.127010:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379648:0@lo:101: 00000100:00100000:2.0:1787862142.127115:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862142.127203:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecfe39eb going to sleep for 11 seconds 00000100:00100000:0.0:1787862142.127672:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379648 00000100:00100000:0.0:1787862142.127680:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379648 00000100:00100000:0.0:1787862142.127739:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862142.127748:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060d14d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:5849:x1874709246379648:12345-0@lo:101: 00010000:00010000:0.0:1787862142.127763:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862142.127780:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd98b8 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.127818:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.127828:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.127836:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001480f53d, rc 0) 00000100:00100000:0.0:1787862142.127895:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060d14d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246379648:12345-0@lo:101: Request processed in 148us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862142.127902:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862142.128184:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379648:0@lo:101: 00010000:00010000:1.0:1787862142.128204:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862142.128214:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862142.128291:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379776:0@lo:501: 00000100:00100000:1.0:1787862142.128327:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.128356:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023b3bf2d going to sleep for 11 seconds 00000100:00100000:0.0:1787862142.128469:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379776 00000100:00100000:0.0:1787862142.128475:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379776 00000100:00100000:0.0:1787862142.128548:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862142.128556:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f00211fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246379776:12345-0@lo:501: 00000100:00100000:0.0:1787862142.129523:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f00211fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246379776:12345-0@lo:501: Request processed in 965us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862142.129536:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787862142.129631:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379776:0@lo:501: 00000100:00100000:1.0:1787862142.129684:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379904:0@lo:503: 00000100:00100000:1.0:1787862142.129734:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.130493:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023b3bf2d going to sleep for 11 seconds 00000100:00100000:2.0:1787862142.130564:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246379904 00000100:00100000:2.0:1787862142.130573:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246379904 00000100:00100000:2.0:1787862142.130614:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862142.130622:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a06eb0e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246379904:12345-0@lo:503: 00000040:00080000:2.0:1787862142.130673:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862142.130735:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a06eb0e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246379904:12345-0@lo:503: Request processed in 114us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862142.130742:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787862142.132240:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246379904:0@lo:503: 00000040:00080000:1.0:1787862142.133841:0:5895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787862142.134077:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787862142.134470:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862142.134507:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862142.134525:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862142.135231:0:5849:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787862142.135239:0:5849:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a102b43800 10000000:01000000:1.0:1787862142.135243:0:5849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a102b43800 10000000:01000000:1.0:1787862142.135250:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862142.135260:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a102b43800 from 1 10000000:01000000:1.0:1787862142.135263:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787862142.135321:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862142.135334:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862142.135346:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862142.135376:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380032:0@lo:101: 00000100:00100000:1.0:1787862142.135490:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.135545:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2b6390a going to sleep for 11 seconds 00000100:00100000:2.0:1787862142.135655:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380032 00000100:00100000:2.0:1787862142.135663:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380032 00000100:00100000:2.0:1787862142.135710:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862142.135719:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b30418b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246380032:12345-0@lo:101: 00010000:00010000:2.0:1787862142.135739:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862142.135753:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001833d0fc/0x391a6cd368cd98cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd98c6 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.135777:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001833d0fc/0x391a6cd368cd98cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.135785:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001833d0fc/0x391a6cd368cd98cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.135790:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001833d0fc, rc 0) 00000100:00100000:2.0:1787862142.135831:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b30418b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5849:x1874709246380032:12345-0@lo:101: Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862142.135836:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787862142.135913:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380032:0@lo:101: 00010000:00010000:1.0:1787862142.135926:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862142.135951:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862142.136000:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380160:0@lo:501: 00000100:00100000:1.0:1787862142.136019:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.136034:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2b6390a going to sleep for 11 seconds 00000100:00100000:0.0:1787862142.136173:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380160 00000100:00100000:0.0:1787862142.136178:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380160 00000100:00100000:0.0:1787862142.136326:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862142.136341:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d50338a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5849:x1874709246380160:12345-0@lo:501: 00000100:00100000:0.0:1787862142.136709:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d50338a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5849:x1874709246380160:12345-0@lo:501: Request processed in 371us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862142.136717:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862142.136791:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380160:0@lo:501: 00000100:00100000:1.0:1787862142.136826:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380288:0@lo:503: 00000100:00100000:1.0:1787862142.136866:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862142.137620:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380288 00000100:00100000:0.0:1787862142.137631:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380288 00000100:00100000:1.0:1787862142.137654:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2b6390a going to sleep for 11 seconds 00000100:00100000:0.0:1787862142.137670:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862142.137677:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a170e5e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5849:x1874709246380288:12345-0@lo:503: 00000100:00100000:1.0:1787862142.138160:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380288:0@lo:503: 00000100:00100000:0.0:1787862142.138293:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a170e5e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5849:x1874709246380288:12345-0@lo:503: Request processed in 418us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862142.138301:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862142.140463:0:5896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f552fd2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5896:1874709246380416:0@lo:502: 00000100:00100000:0.0:1787862142.140573:0:5896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862142.140625:0:5896:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5b5ef77 going to sleep for 11 seconds 00000100:00100000:3.0:1787862142.141201:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380416 00000100:00100000:3.0:1787862142.141209:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380416 00000100:00100000:3.0:1787862142.141254:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787862142.141264:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a5521bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5896:x1874709246380416:12345-0@lo:502: 00000100:00100000:3.0:1787862142.141665:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a5521bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5896:x1874709246380416:12345-0@lo:502: Request processed in 403us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862142.141674:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862142.141850:0:5896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f552fd2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5896:1874709246380416:0@lo:502: 00000020:01000004:0.0:1787862142.141931:0:5896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787862142.141961:0:5896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005841e74e) 00000020:00000080:0.0:1787862142.141988:0:5896:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787862142.143194:0:5896:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c0131f0 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787862142.143216:0:5896:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000c0131f0 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787862142.143219:0:5896:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000c0131f0 4 00010000:00080000:0.0:1787862142.143262:0:5896:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b7d272b5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1787862142.148852:0:5896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787862142.149166:0:5896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787862142.149217:0:5896:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787862142.149235:0:5896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x391a6cd368cd98db 00000100:00080000:0.0:1787862142.149247:0:5896:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787862142.149261:0:5896:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b7d272b5 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1787862142.149305:0:5896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007f552fd2 x1874709246380544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862142.149494:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f552fd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246380544:0@lo:38: 00000100:00100000:3.0:1787862142.149587:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787862142.149672:0:5896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787862142.150210:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380544 00000100:00100000:0.0:1787862142.150221:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380544 00000100:00100000:0.0:1787862142.150263:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862142.150269:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033c3de97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3326:x1874709246380544:12345-0@lo:38: 00000100:00100000:0.0:1787862142.153286:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033c3de97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3326:x1874709246380544:12345-0@lo:38: Request processed in 3004us (3687us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787862142.153306:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862142.155626:0:5896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5896:1874709246380672:0@lo:502: 00000100:00100000:1.0:1787862142.155739:0:5896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.155790:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380672 00000100:00100000:1.0:1787862142.155797:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380672 00000100:00100000:1.0:1787862142.155845:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862142.155853:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab8fefaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5896:x1874709246380672:12345-0@lo:502: 00000100:00100000:1.0:1787862142.156165:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab8fefaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5896:x1874709246380672:12345-0@lo:502: Request processed in 312us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862142.156175:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862142.156260:0:5896:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023b3bf2d going to sleep for 11 seconds 00000100:00100000:1.0:1787862142.156286:0:5896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5896:1874709246380672:0@lo:502: 00000040:00080000:1.0:1787862142.156317:0:5896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787862142.156394:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787862142.156424:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787862142.156437:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862142.156448:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000984977f7/0x391a6cd368cd98c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787862142.156494:0:5849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787862142.156497:0:5849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862142.156499:0:5849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862142.156500:0:5849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862142.156501:0:5849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862142.156503:0:5849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862142.156504:0:5849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862142.156506:0:5849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862142.156507:0:5849:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862142.156509:0:5849:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862142.156511:0:5849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862142.156512:0:5849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787862142.156517:0:5849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787862142.156519:0:5849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787862142.156520:0:5849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862142.156521:0:5849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862142.156522:0:5849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862142.156524:0:5849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862142.156525:0:5849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862142.156526:0:5849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862142.156527:0:5849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862142.156528:0:5849:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862142.156529:0:5849:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862142.156530:0:5849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862142.156531:0:5849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787862142.156544:0:5849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787862142.156553:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380800:0@lo:253: 00000100:00100000:1.0:1787862142.156584:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862142.156599:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000877f92f8 going to sleep for 11 seconds 00000100:00100000:2.0:1787862142.156763:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380800 00000100:00100000:2.0:1787862142.156773:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380800 00000100:00100000:2.0:1787862142.156810:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862142.156817:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076cfa5c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5849:x1874709246380800:12345-0@lo:253: 20000000:01000000:2.0:1787862142.156838:0:5860:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787862142.156856:0:5860:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787862142.159328:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862142.159343:0:3326:0:(import.c:65:import_set_state_nolock()) 00000000b7d272b5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787862142.159352:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787862142.159356:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f552fd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246380544:0@lo:38: 20000000:01000000:1.0:1787862142.229658:0:5860:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787862142.229710:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787862142.229836:0:5884:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787862142.229843:0:5884:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787862142.229871:0:5884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.229898:0:5884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.229907:0:5884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.229959:0:5884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.229976:0:5884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 12 pid: 5860 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862142.229992:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9942e8f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5884:1874709246380928:0@lo:104: 00000100:00100000:2.0:1787862142.230129:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862142.230190:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040f68bc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862142.230277:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246380928 00000100:00100000:3.0:1787862142.230285:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246380928 00000100:00100000:3.0:1787862142.230341:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862142.230360:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3d63718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5884:x1874709246380928:12345-0@lo:104: 00010000:00010000:3.0:1787862142.230376:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230461:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862142.230467:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3d63718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5884:x1874709246380928:12345-0@lo:104: Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862142.230475:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787862142.230499:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862142.230505:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230513:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055ed2042 already unused, calling callback (0000000091241145) 10000000:00010000:3.0:1787862142.230517:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230525:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862142.230532:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862142.230537:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862142.230567:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230574:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862142.230591:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230597:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: 0000000055ed2042/0x391a6cd368cd98aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230625:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862142.230627:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862142.230629:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862142.230692:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862142.230702:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e6fa9d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246381056:0@lo:103: 00000100:00100000:3.0:1787862142.230737:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862142.230775:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381056 00000100:00100000:3.0:1787862142.230780:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381056 00010000:00010000:3.0:1787862142.230798:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 13 pid: 5860 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862142.230820:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862142.230826:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005db21a22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3327:x1874709246381056:12345-0@lo:103: 00010000:00010000:3.0:1787862142.230837:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862142.230841:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 13 pid: 5860 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230850:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 13 pid: 5860 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230866:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230872:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787862142.230887:0:5853:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001045552s 00010000:00010000:3.0:1787862142.230892:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230907:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230914:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230920:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230925:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007680d459 already unused, calling callback (00000000c2a22531) 00010000:00010000:3.0:1787862142.230928:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230935:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230942:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862142.230952:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862142.230979:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005db21a22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3327:x1874709246381056:12345-0@lo:103: Request processed in 154us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862142.230985:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862142.231023:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e6fa9d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246381056:0@lo:103: 00010000:00010000:2.0:1787862142.231836:0:5884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002f5f0b56/0x391a6cd368cd98b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd98aa expref: 12 pid: 5860 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862142.231853:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9942e8f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5884:1874709246380928:0@lo:104: 00010000:00010000:2.0:1787862142.231876:0:5884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.231895:0:5884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.231901:0:5884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862142.231907:0:5884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007680d459/0x391a6cd368cd98e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862142.241958:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076cfa5c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5849:x1874709246380800:12345-0@lo:253: Request processed in 85130us (85361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862142.241979:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862142.242613:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f5fcce8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5849:1874709246380800:0@lo:253: 10000000:01000000:2.0:1787862142.242637:0:5849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787862142.242641:0:5849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787862142.242644:0:5849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862142.242645:0:5849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862142.242646:0:5849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862142.242648:0:5849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862142.242649:0:5849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862142.242650:0:5849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862142.242651:0:5849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862142.242653:0:5849:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862142.242655:0:5849:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862142.242657:0:5849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862142.242658:0:5849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787862142.242678:0:5849:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787862142.256565:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862142.257015:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787862142.257668:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862142.257843:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787862142.260958:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862142.261686:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862142.262820:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862142.263013:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862142.263441:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862142.263628:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862142.263861:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862142.264431:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787862142.392419:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787862142.528236:0:5849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787862142.528410:0:5901:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787862142.528415:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787862142.528770:0:5902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787862142.537270:0:5849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787862142.537443:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787862142.537894:0:5849:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787862142.537901:0:5849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787862142.538029:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862142.568249:0:5849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787862142.568951:0:5849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787862142.568990:0:5849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787862142.569449:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787862142.569718:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787862142.580032:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787862142.580289:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787862142.580560:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787862142.580847:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787862142.581222:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787862142.581396:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787862142.581553:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787862142.581749:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787862142.582079:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787862142.582285:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787862142.591506:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787862142.591758:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787862142.592235:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787862142.592399:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787862142.592939:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787862142.593322:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787862142.596428:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787862142.598557:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787862142.598770:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787862142.600369:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787862142.602103:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787862142.602713:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787862142.602943:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787862142.603108:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787862142.609893:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787862142.610137:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787862142.616725:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787862142.617021:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787862142.619971:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787862142.620263:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787862142.620457:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787862142.620600:0:5849:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787862142.620822:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787862142.726194:0:5902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787862142.935303:0:5849:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787862142.945890:0:5849:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8d281caf988 00100000:10000000:1.0:1787862142.945911:0:5849:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787862142.950922:0:5849:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787862142.950956:0:5849:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787862142.950979:0:5849:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787862142.951017:0:5849:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787862143.042396:0:5902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787862143.042508:0:5902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1787862143.042513:0:5902:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787862143.108321:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862144.137165:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862145.158771:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862146.182150:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787862147.079468:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787862147.079479:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a102b43800 from 3 10000000:01000000:0.0:1787862147.079486:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787862147.079556:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862147.079572:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862147.079585:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862147.079621:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bdb3c20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246381184:0@lo:101: 00000100:00100000:0.0:1787862147.080164:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862147.080357:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381184 00000100:00100000:1.0:1787862147.080369:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381184 00000100:00100000:1.0:1787862147.080442:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787862147.080452:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d53cfd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5865:x1874709246381184:12345-0@lo:101: 00010000:00010000:1.0:1787862147.080476:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862147.080501:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d03890de/0x391a6cd368cd98f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd98e9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862147.080529:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d03890de/0x391a6cd368cd98f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862147.080540:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d03890de/0x391a6cd368cd98f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862147.080550:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d03890de, rc 0) 00000100:00100000:1.0:1787862147.080623:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d53cfd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246381184:12345-0@lo:101: Request processed in 173us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862147.080630:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862147.080821:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073dfb6fe going to sleep for 11 seconds 00000100:00100000:0.0:1787862147.080852:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bdb3c20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246381184:0@lo:101: 00010000:00010000:0.0:1787862147.080868:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862147.080878:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862147.080958:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bdb3c20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246381312:0@lo:256: 00000100:00100000:0.0:1787862147.081000:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862147.081026:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073dfb6fe going to sleep for 11 seconds 00000100:00100000:1.0:1787862147.081937:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381312 00000100:00100000:1.0:1787862147.081952:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381312 00000100:00100000:1.0:1787862147.082013:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787862147.082022:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c3ace36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246381312:12345-0@lo:256: 20000000:01000000:1.0:1787862147.082069:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787862147.082093:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787862147.082096:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787862147.082325:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c3ace36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246381312:12345-0@lo:256: Request processed in 303us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862147.082343:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787862147.082524:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bdb3c20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246381312:0@lo:256: 10000000:01000000:0.0:1787862147.082581:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787862147.082591:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862147.082601:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000ef9f352b/0x391a6cd368cd98e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862147.207894:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862147.593118:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787862147.593133:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787862147.593137:0:8:0:(import.c:65:import_set_state_nolock()) 00000000b7d272b5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862147.593153:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b7d272b5 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862147.593205:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f12295e9 x1874709246381440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862147.593768:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f12295e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246381440:0@lo:38: 00000100:00100000:3.0:1787862147.593873:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862147.598832:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381440 00000100:00100000:1.0:1787862147.598852:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381440 00000100:00100000:1.0:1787862147.598907:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862147.598915:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b02377 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3326:x1874709246381440:12345-0@lo:38: 00010000:00080000:1.0:1787862147.598951:0:5870:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1787862147.598996:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x391a6cd368cd98f7 00000004:00100000:1.0:1787862147.599071:0:5870:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787862147.599233:0:5870:0:(import.c:65:import_set_state_nolock()) 00000000269fe9ad : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862147.599385:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b02377 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874709246381440:12345-0@lo:38: Request processed in 468us (5512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862147.599394:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787862147.599616:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f12295e9 x1874709246381440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787862147.599637:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787862147.599646:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787862147.599653:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787862147.599656:0:3326:0:(import.c:65:import_set_state_nolock()) 00000000b7d272b5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787862147.599662:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f12295e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246381440:0@lo:38: 00010000:00010000:3.0:1787862148.235572:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862148.631303:0:6145:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787862149.259443:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862150.278460:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862151.301400:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862152.326545:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862152.708936:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042721a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246381568:0@lo:400: 00000100:00100000:0.0:1787862152.709081:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862152.709162:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862152.709169:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246381696:0@lo:400: 00000100:00100000:0.0:1787862152.709207:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862152.709245:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381696 00000100:00100000:0.0:1787862152.709254:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381696 00000100:00100000:0.0:1787862152.709318:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862152.709326:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bdb3c20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246381696:12345-0@lo:400: 00000100:00100000:0.0:1787862152.709384:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bdb3c20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246381696:12345-0@lo:400: Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862152.709392:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787862152.709439:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003968f8f6 x1874709246381696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862152.709456:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003968f8f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246381696:0@lo:400: 00000100:00100000:2.0:1787862152.709899:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381568 00000100:00100000:2.0:1787862152.709907:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381568 00000100:00100000:2.0:1787862152.709949:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862152.709956:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7eba48a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3329:x1874709246381568:12345-0@lo:400: 00000100:00100000:2.0:1787862152.710009:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7eba48a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3329:x1874709246381568:12345-0@lo:400: Request processed in 54us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862152.710017:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862152.710155:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042721a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246381568:0@lo:400: 00010000:00010000:3.0:1787862153.369526:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787862154.355718:0:6347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce0520d90 20000000:00000080:2.0:1787862154.357826:0:6347:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a13f9ab400 uarg=0000000000000000 20000000:01000000:2.0:1787862154.357905:0:6347:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787862154.357915:0:6347:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787862154.357924:0:6347:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787862154.360174:0:6347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787862154.360386:0:6347:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00010000:00010000:3.0:1787862154.372380:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862154.375390:0:6347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862154.380551:0:6347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787862154.380843:0:6347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787862154.381424:0:6347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787862154.381473:0:6347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787862154.381502:0:6347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.381528:0:6347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.381538:0:6347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.381594:0:6347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.381614:0:6347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 11 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862154.381630:0:6347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c655370 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6347:1874709246381824:0@lo:104: 00000100:00100000:1.0:1787862154.382534:0:6347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862154.382673:0:6347:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdc86083 going to sleep for 11 seconds 00000100:00100000:3.0:1787862154.393231:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381824 00000100:00100000:3.0:1787862154.393256:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381824 00000100:00100000:3.0:1787862154.393393:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862154.393405:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f35e4fd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:6347:x1874709246381824:12345-0@lo:104: 00010000:00010000:3.0:1787862154.393431:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.393614:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862154.393620:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f35e4fd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:6347:x1874709246381824:12345-0@lo:104: Request processed in 218us (11095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862154.393628:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787862154.393683:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862154.393690:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.393698:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf6ff60a already unused, calling callback (0000000091241145) 10000000:00010000:3.0:1787862154.393702:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.393710:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862154.393718:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862154.393724:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862154.398142:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398166:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862154.398190:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398197:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: 00000000cf6ff60a/0x391a6cd368cd98b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398243:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862154.398246:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862154.398248:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862154.398280:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba3896de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246381952:0@lo:103: 00000100:00100000:3.0:1787862154.398366:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862154.398447:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246381952 00000100:00100000:3.0:1787862154.398455:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246381952 00010000:00010000:3.0:1787862154.398494:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 12 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862154.398526:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862154.398535:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e6fa9d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3327:x1874709246381952:12345-0@lo:103: 00010000:00010000:3.0:1787862154.398550:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862154.398554:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 12 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398566:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 12 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398587:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398596:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398613:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398619:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398630:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398636:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398642:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ad8cbca already unused, calling callback (00000000c2a22531) 00010000:00010000:3.0:1787862154.398645:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398824:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398833:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862154.398843:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862154.398880:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e6fa9d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3327:x1874709246381952:12345-0@lo:103: Request processed in 347us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862154.398887:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862154.399006:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba3896de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246381952:0@lo:103: 00010000:00010000:1.0:1787862154.399173:0:6347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001480f53d/0x391a6cd368cd98bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd98b8 expref: 11 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862154.399189:0:6347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c655370 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6347:1874709246381824:0@lo:104: 00010000:00010000:1.0:1787862154.399204:0:6347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.399224:0:6347:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.399230:0:6347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862154.399234:0:6347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ad8cbca/0x391a6cd368cd98fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862155.396345:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862156.420471:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862157.452821:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862157.833945:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa0de1b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246382208:0@lo:400: 00000100:00100000:0.0:1787862157.834075:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862157.836246:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb49904c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246382080:0@lo:400: 00000100:00100000:2.0:1787862157.836379:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862157.836506:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382208 00000100:00100000:2.0:1787862157.836515:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382208 00000100:00100000:2.0:1787862157.836575:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862157.836585:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c944ac2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246382208:12345-0@lo:400: 00000100:00100000:2.0:1787862157.836668:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c944ac2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246382208:12345-0@lo:400: Request processed in 84us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862157.836676:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787862157.836762:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fa0de1b3 x1874709246382208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862157.836783:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa0de1b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246382208:0@lo:400: 00000100:00100000:2.0:1787862157.836968:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382080 00000100:00100000:2.0:1787862157.836974:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382080 00000100:00100000:2.0:1787862157.837019:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862157.837027:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d8c7af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:3328:x1874709246382080:12345-0@lo:400: 00000100:00100000:2.0:1787862157.837095:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d8c7af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:3328:x1874709246382080:12345-0@lo:400: Request processed in 69us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862157.837101:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862157.837140:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb49904c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246382080:0@lo:400: 00010000:00010000:3.0:1787862158.477249:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862159.498555:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862160.516352:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787862161.417436:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787862161.417448:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102b43800 from 1 10000000:01000000:3.0:1787862161.417455:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862161.417515:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000010e16c0b/0x391a6cd368cd9905 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862161.417546:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000010e16c0b/0x391a6cd368cd9905 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862161.417570:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000010e16c0b/0x391a6cd368cd9905 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862161.417604:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba3896de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246382336:0@lo:101: 00000100:00100000:3.0:1787862161.417704:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862161.417756:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e1c368a going to sleep for 11 seconds 00000100:00100000:0.0:1787862161.418021:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382336 00000100:00100000:0.0:1787862161.418032:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382336 00000100:00100000:0.0:1787862161.418144:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862161.418153:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:5865:x1874709246382336:12345-0@lo:101: 00010000:00010000:0.0:1787862161.418173:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862161.418190:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd5867a4/0x391a6cd368cd990c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9905 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862161.418229:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd5867a4/0x391a6cd368cd990c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862161.418240:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd5867a4/0x391a6cd368cd990c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862161.418250:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd5867a4, rc 0) 00000100:00100000:0.0:1787862161.418300:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246382336:12345-0@lo:101: Request processed in 148us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862161.418308:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862161.418362:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba3896de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246382336:0@lo:101: 00010000:00010000:0.0:1787862161.418377:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000010e16c0b/0x391a6cd368cd9905 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862161.418386:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000010e16c0b/0x391a6cd368cd9905 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862161.418450:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb63e4ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246382464:0@lo:501: 00000100:00100000:0.0:1787862161.418493:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862161.418511:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052c0e404 going to sleep for 11 seconds 00000100:00100000:3.0:1787862161.419868:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382464 00000100:00100000:3.0:1787862161.419887:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382464 00000100:00100000:3.0:1787862161.419953:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787862161.419963:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af85ea5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246382464:12345-0@lo:501: 00000100:00100000:3.0:1787862161.420994:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af85ea5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246382464:12345-0@lo:501: Request processed in 1024us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862161.421009:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787862161.421824:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb63e4ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246382464:0@lo:501: 00000100:00100000:0.0:1787862161.421901:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb63e4ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246382592:0@lo:503: 00000100:00100000:0.0:1787862161.421975:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862161.422018:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052c0e404 going to sleep for 11 seconds 00000100:00100000:0.0:1787862161.422071:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382592 00000100:00100000:0.0:1787862161.422078:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382592 00000100:00100000:0.0:1787862161.422212:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862161.422221:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b40d71d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246382592:12345-0@lo:503: 00000100:00100000:0.0:1787862161.422449:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b40d71d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246382592:12345-0@lo:503: Request processed in 229us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862161.422458:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862161.422506:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb63e4ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246382592:0@lo:503: 00000100:00100000:0.0:1787862161.426390:0:6619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb63e4ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6619:1874709246382720:0@lo:502: 00000100:00100000:0.0:1787862161.427347:0:6619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862161.427409:0:6619:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b038e6fe going to sleep for 11 seconds 00000100:00100000:3.0:1787862161.427949:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382720 00000100:00100000:3.0:1787862161.427960:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382720 00000100:00100000:3.0:1787862161.428037:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862161.428084:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0489210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6619:x1874709246382720:12345-0@lo:502: 00000100:00100000:3.0:1787862161.428426:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0489210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6619:x1874709246382720:12345-0@lo:502: Request processed in 345us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862161.428435:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862161.428758:0:6619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb63e4ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6619:1874709246382720:0@lo:502: 00000020:01000000:0.0:1787862161.428815:0:6619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862161.428827:0:6619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862161.428830:0:6619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787862161.428838:0:6619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a102b43800 00000020:00000080:0.0:1787862161.428842:0:6619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787862161.428911:0:6619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120462d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6619:1874709246382848:0@lo:502: 00000100:00100000:0.0:1787862161.428959:0:6619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862161.428999:0:6619:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11026a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862161.429119:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382848 00000100:00100000:3.0:1787862161.429126:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382848 00000100:00100000:3.0:1787862161.429163:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862161.429171:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6619:x1874709246382848:12345-0@lo:502: 00000100:00100000:3.0:1787862161.429360:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6619:x1874709246382848:12345-0@lo:502: Request processed in 189us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862161.429371:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862161.429655:0:6619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120462d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6619:1874709246382848:0@lo:502: 00000020:01000000:0.0:1787862161.429681:0:6619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862161.429687:0:6619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862161.429689:0:6619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787862161.429693:0:6619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787862161.431077:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787862161.431147:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862161.431163:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862161.431181:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862161.542131:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862162.566308:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862162.948637:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862162.948675:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120581a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246382976:0@lo:400: 00000100:00100000:1.0:1787862162.948783:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862162.948952:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246382976 00000100:00100000:0.0:1787862162.948963:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246382976 00000100:00100000:0.0:1787862162.949028:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862162.949066:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3329:x1874709246382976:12345-0@lo:400: 00000100:00100000:0.0:1787862162.949149:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3329:x1874709246382976:12345-0@lo:400: Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862162.949159:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862162.949330:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862162.949344:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246383104:0@lo:400: 00000100:00100000:0.0:1787862162.949379:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862162.949425:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383104 00000100:00100000:0.0:1787862162.949431:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383104 00000100:00100000:0.0:1787862162.949464:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862162.949470:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246383104:12345-0@lo:400: 00000100:00100000:0.0:1787862162.949514:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246383104:12345-0@lo:400: Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862162.949521:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787862162.949564:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a120580000 x1874709246383104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862162.949581:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246383104:0@lo:400: 00000100:00100000:1.0:1787862162.950284:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120581a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246382976:0@lo:400: 00010000:00010000:1.0:1787862163.588346:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787862164.579449:0:6707:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787862164.579456:0:6707:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787862164.579619:0:6707:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89a1102e9000 00000020:01000004:1.0:1787862164.579641:0:6707:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787862164.579657:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787862164.579675:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89a13bb59a48) 00000020:00000080:1.0:1787862164.579695:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787862164.598701:0:6707:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787862164.599219:0:6707:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:3.0:1787862164.618533:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787862164.648777:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787862164.661780:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787862164.661905:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787862164.662108:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787862164.662156:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787862164.662801:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787862164.662903:0:6707:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787862164.662919:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x391a6cd368cd991a 00000020:01000004:1.0:1787862164.662929:0:6707:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787862164.663203:0:6707:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787862164.663208:0:6707:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787862164.663217:0:6707:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787862164.663453:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787862164.663488:0:6707:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89a11102ced8) 00000020:00000080:2.0:1787862164.663505:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787862164.665811:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862164.667142:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862164.667155:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787862164.680712:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787862164.680735:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787862164.686221:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787862164.686239:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787862164.688716:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787862164.689280:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787862164.689288:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787862164.690216:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787862164.690226:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787862164.719812:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862164.720438:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862164.720447:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787862164.724236:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862164.724267:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787862164.740165:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862164.740199:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787862164.747812:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862164.751552:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787862164.751562:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787862164.752650:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787862164.752660:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787862164.851162:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862164.852761:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787862164.852769:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787862164.859369:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787862164.859391:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787862164.862397:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787862164.862435:0:6707:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787862164.862445:0:6707:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787862164.927420:0:6707:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787862164.927503:0:6707:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787862164.927508:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787862164.927511:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862164.927512:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862164.927513:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862164.927515:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862164.927522:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862164.927524:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862164.927533:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862164.927534:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862164.927536:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862164.927537:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862164.927541:0:6707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787862164.927544:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862164.927545:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862164.927546:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862164.927547:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862164.927548:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862164.927549:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862164.927549:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862164.927550:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862164.927551:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862164.927552:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862164.927553:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862164.927599:0:6707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787862164.927628:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1207783c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246383232:0@lo:253: 00000100:00100000:2.0:1787862164.927731:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862164.927806:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862164.927971:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383232 00000100:00100000:0.0:1787862164.927983:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383232 00000100:00100000:0.0:1787862164.928094:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787862164.928106:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246383232:12345-0@lo:253: 20000000:01000000:0.0:1787862164.928152:0:5860:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787862164.928158:0:5860:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787862164.928176:0:5860:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787862164.928181:0:5860:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787862164.929416:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862164.929714:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787862164.929730:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787862164.929772:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787862164.929781:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787862164.929813:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787862164.929871:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787862164.930374:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787862164.930417:0:5860:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:1.0:1787862164.930419:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:1.0:1787862164.930459:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787862164.930467:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787862164.930513:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787862164.930521:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:1.0:1787862164.930553:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787862164.930563:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787862164.930595:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787862164.930649:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787862164.941514:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787862164.941556:0:5860:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:2.0:1787862164.941560:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:2.0:1787862164.941600:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787862164.941609:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787862164.941674:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787862164.941683:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:2.0:1787862164.943871:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787862164.943911:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787862164.944274:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787862164.944325:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787862164.944366:0:5860:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787862164.944371:0:5860:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787862164.944397:0:5860:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787862164.944418:0:5860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787862164.944421:0:5860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787862164.944484:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787862164.944487:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787862164.946425:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787862164.947355:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787862164.947413:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787862164.947503:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787862164.947520:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787862164.947524:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787862164.952523:0:6723:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787862164.952648:0:6723:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787862164.952706:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787862164.956941:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787862164.957008:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787862164.957072:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787862164.957092:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787862164.957097:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862164.957944:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862164.958029:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862164.958129:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787862164.958655:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787862164.958699:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787862164.958809:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787862164.958833:0:5860:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787862164.958836:0:5860:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787862164.958847:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787862164.958873:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.958902:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd983a expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.958910:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.958918:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.958928:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.958986:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.959003:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 12 pid: 5860 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862164.959023:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204612c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246383360:0@lo:104: 00000100:00100000:0.0:1787862164.959159:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862164.959257:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.959266:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 12 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862164.959275:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246383488:0@lo:104: 00000100:00100000:0.0:1787862164.959297:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862164.959320:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd983a expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.959334:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd983a expref: 12 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862164.959343:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204603c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246383616:0@lo:104: 00000100:00100000:0.0:1787862164.959365:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862164.959375:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862164.959565:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383360 00000100:00100000:1.0:1787862164.959578:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383360 00000100:00100000:1.0:1787862164.959621:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383488 00000100:00100000:1.0:1787862164.959625:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383488 00000100:00100000:1.0:1787862164.959635:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383616 00000100:00100000:1.0:1787862164.959638:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383616 00000100:00100000:1.0:1787862164.959653:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862164.959662:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5860:x1874709246383360:12345-0@lo:104: 00010000:00010000:1.0:1787862164.959689:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.959765:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862164.959771:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5860:x1874709246383360:12345-0@lo:104: Request processed in 110us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862164.959780:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862164.959802:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862164.959807:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120461a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:5860:x1874709246383488:12345-0@lo:104: 00010000:00010000:1.0:1787862164.959814:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.959850:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787862164.959854:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120461a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:5860:x1874709246383488:12345-0@lo:104: Request processed in 48us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862164.959860:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862164.959873:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862164.959878:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120461680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5860:x1874709246383616:12345-0@lo:104: 00010000:00010000:1.0:1787862164.959886:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.959936:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787862164.959941:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120461680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5860:x1874709246383616:12345-0@lo:104: Request processed in 63us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862164.959946:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787862164.959965:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787862164.959972:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.959985:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862164.959989:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.959999:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862164.960006:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862164.960012:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862164.960086:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960095:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862164.960115:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960123:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a8400/0x391a6cd368cd98c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960140:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862164.960144:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960150:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030200 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862164.960153:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960184:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862164.960190:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862164.960196:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862164.960211:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960217:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862164.960232:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960239:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030200/0x391a6cd368cd9856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd985d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960249:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862164.960252:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960257:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9800 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862164.960260:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960266:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862164.960272:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862164.960284:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862164.960298:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960304:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862164.960309:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960316:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd983a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9841 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960331:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862164.960333:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862164.960334:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862164.960358:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246383744:0@lo:103: 00000100:00100000:1.0:1787862164.960399:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862164.960441:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120581e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246383872:0@lo:103: 00000100:00100000:1.0:1787862164.960464:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862164.960482:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862164.960487:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246384000:0@lo:103: 00000100:00100000:1.0:1787862164.960522:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862164.960561:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383744 00000100:00100000:1.0:1787862164.960568:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383744 00010000:00010000:1.0:1787862164.960590:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 13 pid: 5860 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862164.960608:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246383872 00000100:00100000:1.0:1787862164.960610:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246383872 00010000:00010000:1.0:1787862164.960627:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 14 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862164.960639:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384000 00000100:00100000:1.0:1787862164.960642:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384000 00010000:00010000:1.0:1787862164.960652:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd983a expref: 15 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862164.960664:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862164.960670:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:3328:x1874709246383744:12345-0@lo:103: 00010000:00010000:1.0:1787862164.960684:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862164.960691:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 15 pid: 5860 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960703:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 15 pid: 5860 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960725:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862164.960755:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:3328:x1874709246383744:12345-0@lo:103: Request processed in 85us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862164.960763:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862164.960776:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862164.960782:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120582580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3329:x1874709246383872:12345-0@lo:103: 00010000:00010000:1.0:1787862164.960791:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862164.960795:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 14 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960803:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 14 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960824:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862164.960855:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120582580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3329:x1874709246383872:12345-0@lo:103: Request processed in 73us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862164.960863:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862164.960877:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862164.960883:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120582d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3329:x1874709246384000:12345-0@lo:103: 00010000:00010000:1.0:1787862164.960891:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862164.960895:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd983a expref: 13 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960904:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd983a expref: 13 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960917:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960925:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960943:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960951:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960958:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960966:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960978:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862164.960983:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.960993:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.961002:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862164.961013:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862164.961037:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120582d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3329:x1874709246384000:12345-0@lo:103: Request processed in 155us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862164.961077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862164.961128:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246383744:0@lo:103: 00000100:00100000:1.0:1787862164.961164:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246384000:0@lo:103: 00000100:00100000:1.0:1787862164.961185:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120581e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246383872:0@lo:103: 00010000:00010000:0.0:1787862164.961438:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211400/0x391a6cd368cd98cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd98c6 expref: 12 pid: 5860 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862164.961456:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204612c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246383360:0@lo:104: 00010000:00010000:0.0:1787862164.961466:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210600/0x391a6cd368cd985d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9856 expref: 11 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862164.961475:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246383488:0@lo:104: 00010000:00010000:0.0:1787862164.961483:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd983a expref: 10 pid: 5862 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862164.961490:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204603c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246383616:0@lo:104: 00010000:00010000:0.0:1787862164.961515:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.961525:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.961531:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862164.961539:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030400/0x391a6cd368cd9928 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787862164.961567:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1787862164.961903:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862165.226231:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:6707:x1874709246383232:12345-0@lo:253: Request processed in 298110us (298482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862165.226253:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787862165.226471:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1207783c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246383232:0@lo:253: 10000000:01000000:0.0:1787862165.226492:0:6707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787862165.226496:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862165.226498:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862165.226499:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862165.226500:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787862165.226501:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862165.226503:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862165.226505:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862165.226507:0:6707:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787862165.226509:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862165.226510:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787862165.226538:0:6707:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a1102e9000 from lustre-OST0000 10000000:01000000:0.0:1787862165.226575:0:6707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787862165.226579:0:6707:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787862165.226589:0:6707:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a108763490 local copy 10000000:01000000:0.0:1787862165.226594:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787862165.226642:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.226654:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.226663:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862165.226685:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384128:0@lo:101: 00000100:00100000:0.0:1787862165.226744:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862165.226829:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.231539:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384128 00000100:00100000:3.0:1787862165.231558:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384128 00000100:00100000:3.0:1787862165.231642:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862165.231655:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:6707:x1874709246384128:12345-0@lo:101: 00010000:00010000:3.0:1787862165.231679:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862165.231712:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd992f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.231761:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd992f expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.231775:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd992f expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.231786:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2ce00, rc 0) 00000100:00100000:3.0:1787862165.231914:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:6707:x1874709246384128:12345-0@lo:101: Request processed in 262us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.231922:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862165.232469:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384128:0@lo:101: 00010000:00010000:1.0:1787862165.232495:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.232507:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862165.232694:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120581e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384256:0@lo:501: 00000100:00100000:1.0:1787862165.232760:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862165.232805:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203840 going to sleep for 11 seconds 00000100:00100000:2.0:1787862165.233029:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384256 00000100:00100000:2.0:1787862165.233036:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384256 00000100:00100000:2.0:1787862165.233127:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862165.233137:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:6707:x1874709246384256:12345-0@lo:501: 00000100:00100000:2.0:1787862165.233419:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:6707:x1874709246384256:12345-0@lo:501: Request processed in 282us (657us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862165.233427:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787862165.238149:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120581e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384256:0@lo:501: 10000000:01000000:1.0:1787862165.238203:0:6707:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787862165.238301:0:6707:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787862165.238315:0:6707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.238328:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.238336:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.238371:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862165.238419:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a1102e9000 10000000:01000000:1.0:1787862165.238428:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787862165.238435:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89a108763490 10000000:01000000:1.0:1787862165.238438:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787862165.238442:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89a108763490 from 1 10000000:01000000:1.0:1787862165.238445:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787862165.238490:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.238498:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.238533:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862165.238560:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120581e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384384:0@lo:101: 00000100:00100000:1.0:1787862165.238655:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862165.238709:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787862165.239082:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862165.239093:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.239102:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862165.239107:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.239118:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862165.239126:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862165.239142:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862165.239189:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.239196:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862165.239222:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.239230:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd992f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x391a6cd368cd9936 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.239251:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862165.239253:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862165.239254:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862165.239265:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862165.239280:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246384512:0@lo:103: 00000100:00100000:3.0:1787862165.239323:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862165.239367:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384512 00000100:00100000:3.0:1787862165.239375:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384512 00000100:00100000:3.0:1787862165.239448:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862165.239458:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:3328:x1874709246384512:12345-0@lo:103: 00010000:00010000:3.0:1787862165.239473:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862165.239490:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd992f expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.239508:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862165.239547:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:3328:x1874709246384512:12345-0@lo:103: Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.239563:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862165.239608:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246384512:0@lo:103: 00000100:00100000:2.0:1787862165.240161:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384384 00000100:00100000:2.0:1787862165.240179:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384384 00000100:00100000:2.0:1787862165.240233:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862165.240242:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:6707:x1874709246384384:12345-0@lo:101: 00010000:00010000:2.0:1787862165.240262:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862165.240286:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b210000/0x391a6cd368cd9944 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd993d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.240312:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210000/0x391a6cd368cd9944 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd993d expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.240325:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b210000/0x391a6cd368cd9944 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd993d expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.240352:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b210000, rc 0) 00000100:00100000:2.0:1787862165.240435:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:6707:x1874709246384384:12345-0@lo:101: Request processed in 193us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.240443:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787862165.240550:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120581e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384384:0@lo:101: 00010000:00010000:0.0:1787862165.240577:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.240586:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862165.240612:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787862165.240628:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.240636:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862165.240645:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787862165.240652:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862165.240660:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787862165.240663:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862165.240692:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.240699:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.240707:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862165.240738:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384640:0@lo:101: 00000100:00100000:0.0:1787862165.240776:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862165.240824:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862165.241244:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384640 00000100:00100000:2.0:1787862165.241251:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384640 00000100:00100000:2.0:1787862165.241290:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787862165.241297:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+10:6707:x1874709246384640:12345-0@lo:101: 00010000:00010000:2.0:1787862165.241306:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862165.241318:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd994b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.241334:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd994b expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.241342:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd994b expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.241349:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b211600, rc 0) 00000100:00100000:2.0:1787862165.241386:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246384640:12345-0@lo:101: Request processed in 89us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.241392:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787862165.242557:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384640:0@lo:101: 00010000:00010000:0.0:1787862165.242609:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.242620:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862165.242948:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384768:0@lo:501: 00000100:00100000:0.0:1787862165.243035:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862165.243114:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.243286:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384768 00000100:00100000:3.0:1787862165.243293:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384768 00000100:00100000:3.0:1787862165.243337:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787862165.243347:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246384768:12345-0@lo:501: 00000100:00100000:3.0:1787862165.243664:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246384768:12345-0@lo:501: Request processed in 318us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.243672:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862165.244124:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384768:0@lo:501: 00000100:00100000:0.0:1787862165.244190:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384896:0@lo:503: 00000100:00100000:0.0:1787862165.244256:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862165.244288:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.244381:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246384896 00000100:00100000:3.0:1787862165.244387:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246384896 00000100:00100000:3.0:1787862165.244581:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787862165.244591:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246384896:12345-0@lo:503: 00000100:00100000:3.0:1787862165.244941:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246384896:12345-0@lo:503: Request processed in 349us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.244949:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787862165.250696:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246384896:0@lo:503: 00000040:00080000:2.0:1787862165.256756:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862165.256979:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385024:0@lo:502: 00000100:00100000:2.0:1787862165.260393:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.260563:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862165.264159:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385024 00000100:00100000:1.0:1787862165.264191:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385024 00000100:00100000:0.0:1787862165.268316:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787862165.268335:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246385024:12345-0@lo:502: 00000100:00100000:0.0:1787862165.268744:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246385024:12345-0@lo:502: Request processed in 412us (8361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862165.268752:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787862165.268893:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385024:0@lo:502: 00000040:00080000:2.0:1787862165.269246:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787862165.269303:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787862165.269330:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787862165.269382:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787862165.269415:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787862165.269441:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787862165.269482:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385152:0@lo:502: 00000100:00100000:2.0:1787862165.269538:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.276222:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.281719:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385152 00000100:00100000:3.0:1787862165.281746:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385152 00000100:00100000:3.0:1787862165.281837:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787862165.281849:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246385152:12345-0@lo:502: 00000100:00100000:3.0:1787862165.282387:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246385152:12345-0@lo:502: Request processed in 539us (12847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.282397:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787862165.282696:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385152:0@lo:502: 00000040:00080000:2.0:1787862165.283194:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787862165.283214:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787862165.286218:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787862165.286234:0:6727:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787862165.286243:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862165.286246:0:6727:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787862165.286252:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862165.286271:0:6727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89a11102b490) 00000020:00000080:2.0:1787862165.286300:0:6727:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787862165.286306:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787862165.286911:0:6727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a1102e9000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787862165.286922:0:6727:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787862165.286932:0:6727:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x391a6cd368cd9960 00010000:00010000:2.0:1787862165.300618:0:6727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787862165.302269:0:6727:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787862165.312206:0:6727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787862165.312675:0:6727:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787862165.337267:0:6727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787862165.343896:0:6727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787862165.369401:0:6727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787862165.369422:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862165.369433:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862165.369435:0:6727:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787862165.369440:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862165.369463:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862165.369465:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787862165.369470:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787862165.369472:0:6727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787862165.369542:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862165.369546:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862165.369547:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787862165.369551:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787862165.373282:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787862165.373353:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787862165.373389:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.373403:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862165.373412:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a1102e9000 from 1 10000000:01000000:3.0:1787862165.373415:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862165.373466:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.373475:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.373488:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862165.373521:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385280:0@lo:101: 00000100:00100000:3.0:1787862165.373620:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862165.373674:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.373712:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385280 00000100:00100000:3.0:1787862165.373720:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385280 00000100:00100000:3.0:1787862165.373787:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787862165.373797:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:6707:x1874709246385280:12345-0@lo:101: 00010000:00010000:3.0:1787862165.375228:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862165.375265:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9967 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.375320:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.375345:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.375356:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862165.375521:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385280:12345-0@lo:101: Request processed in 1723us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.375531:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862165.379116:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385280:0@lo:101: 00010000:00010000:0.0:1787862165.379160:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.379187:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862165.379407:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385408:0@lo:501: 00000100:00100000:0.0:1787862165.379489:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862165.379625:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729000 going to sleep for 11 seconds 00000100:00100000:0.0:1787862165.386250:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385408 00000100:00100000:0.0:1787862165.386272:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385408 00000100:00100000:0.0:1787862165.386391:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862165.386405:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385408:12345-0@lo:501: 00000100:00100000:0.0:1787862165.389067:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385408:12345-0@lo:501: Request processed in 2640us (9550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862165.389086:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787862165.394195:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385408:0@lo:501: 00000100:00100000:1.0:1787862165.394292:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385536:0@lo:503: 00000100:00100000:1.0:1787862165.394420:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862165.394490:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203840 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.395512:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385536 00000100:00100000:3.0:1787862165.395524:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385536 00000100:00100000:3.0:1787862165.395632:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787862165.395645:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385536:12345-0@lo:503: 00000100:00100000:2.0:1787862165.396378:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385536:12345-0@lo:503: Request processed in 730us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.396389:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862165.396546:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385536:0@lo:503: 00000040:00080000:1.0:1787862165.397037:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862165.397179:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385664:0@lo:502: 00000100:00100000:1.0:1787862165.397246:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862165.405273:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203840 going to sleep for 11 seconds 00000100:00100000:0.0:1787862165.408964:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385664 00000100:00100000:0.0:1787862165.408998:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385664 00000100:00100000:0.0:1787862165.409213:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787862165.409227:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385664:12345-0@lo:502: 00000100:00100000:0.0:1787862165.409656:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385664:12345-0@lo:502: Request processed in 432us (12409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862165.409664:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787862165.411748:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385664:0@lo:502: 00000040:00080000:1.0:1787862165.412226:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787862165.412303:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787862165.412354:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385792:0@lo:502: 00000100:00100000:1.0:1787862165.412464:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862165.412514:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203840 going to sleep for 11 seconds 00000100:00100000:0.0:1787862165.412786:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385792 00000100:00100000:0.0:1787862165.412796:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385792 00000100:00100000:0.0:1787862165.412882:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862165.412894:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385792:12345-0@lo:502: 00000100:00100000:0.0:1787862165.413217:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385792:12345-0@lo:502: Request processed in 324us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862165.413226:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862165.413735:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385792:0@lo:502: 00000040:00080000:1.0:1787862165.414022:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787862165.414226:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787862165.415508:0:6731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862165.415524:0:6731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862165.415527:0:6731:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787862165.415535:0:6731:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a1102e9000 00000020:00000080:1.0:1787862165.415538:0:6731:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787862165.415559:0:6731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862165.415562:0:6731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862165.415564:0:6731:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787862165.415567:0:6731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787862165.415707:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787862165.415757:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862165.415793:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.416523:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862165.416603:0:6707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787862165.416607:0:6707:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a1102e9000 10000000:01000000:0.0:1787862165.416611:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a1102e9000 10000000:01000000:0.0:1787862165.416616:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862165.416625:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a1102e9000 from 1 10000000:01000000:0.0:1787862165.416628:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787862165.416687:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.416697:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.416711:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862165.416759:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385920:0@lo:101: 00000100:00100000:0.0:1787862165.417029:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862165.417265:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1089010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.417336:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246385920 00000100:00100000:3.0:1787862165.417345:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246385920 00000100:00100000:3.0:1787862165.417409:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787862165.417420:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246385920:12345-0@lo:101: 00010000:00010000:3.0:1787862165.417439:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862165.417457:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9975 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.417488:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.417503:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.417513:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2da00, rc 0) 00000100:00100000:3.0:1787862165.417575:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246385920:12345-0@lo:101: Request processed in 157us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.417602:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862165.417719:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246385920:0@lo:101: 00010000:00010000:1.0:1787862165.417751:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.417760:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862165.417906:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386048:0@lo:501: 00000100:00100000:1.0:1787862165.417942:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862165.417976:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.418296:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386048 00000100:00100000:3.0:1787862165.418303:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386048 00000100:00100000:3.0:1787862165.418335:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787862165.418342:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386048:12345-0@lo:501: 00000100:00100000:3.0:1787862165.418670:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386048:12345-0@lo:501: Request processed in 327us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.418679:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787862165.418796:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386048:0@lo:501: 00000100:00100000:3.0:1787862165.418927:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386176:0@lo:503: 00000100:00100000:3.0:1787862165.418985:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862165.419206:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862165.419206:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386176 00000100:00100000:2.0:1787862165.419213:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386176 00000100:00100000:2.0:1787862165.419243:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787862165.419251:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386176:12345-0@lo:503: 00000100:00100000:2.0:1787862165.419461:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386176:12345-0@lo:503: Request processed in 210us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.419468:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787862165.419535:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386176:0@lo:503: 00000040:00080000:3.0:1787862165.420226:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862165.420330:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386304:0@lo:502: 00000100:00100000:3.0:1787862165.420409:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862165.420521:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862165.424277:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386304 00000100:00100000:0.0:1787862165.424300:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386304 00000100:00100000:0.0:1787862165.424395:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862165.424408:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386304:12345-0@lo:502: 00000100:00100000:0.0:1787862165.424877:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386304:12345-0@lo:502: Request processed in 470us (4466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862165.424897:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787862165.425258:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386304:0@lo:502: 00000040:00080000:2.0:1787862165.425621:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787862165.425684:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787862165.425712:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787862165.425750:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787862165.425778:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787862165.425827:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787862165.425863:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787862165.425897:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787862165.425967:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787862165.426005:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787862165.426075:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787862165.426135:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787862165.426200:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787862165.426255:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787862165.426310:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787862165.426347:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787862165.426381:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787862165.426429:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787862165.426464:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787862165.426496:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787862165.426564:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787862165.426603:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787862165.426643:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787862165.426699:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787862165.426737:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787862165.426774:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787862165.426829:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787862165.426867:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787862165.426939:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386432:0@lo:502: 00000100:00100000:2.0:1787862165.427095:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.427154:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862165.427175:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386432 00000100:00100000:3.0:1787862165.427186:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386432 00000100:00100000:3.0:1787862165.427243:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787862165.427253:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386432:12345-0@lo:502: 00000100:00100000:3.0:1787862165.427525:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386432:12345-0@lo:502: Request processed in 272us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.427533:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787862165.429735:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386432:0@lo:502: 00000040:00080000:3.0:1787862165.430138:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787862165.430188:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787862165.437620:0:6732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787862165.437647:0:6732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89a102b3ced8) 00000020:00000080:3.0:1787862165.437676:0:6732:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787862165.439260:0:6732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a1102e9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787862165.439275:0:6732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a1102e9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787862165.439279:0:6732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a1102e9000 3 00010000:00080000:3.0:1787862165.439327:0:6732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a116a8f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.109@tcp at head 00010000:00010000:3.0:1787862165.452268:0:6732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787862165.452659:0:6732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787862165.452700:0:6732:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787862165.452714:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x391a6cd368cd998a 00000100:00080000:3.0:1787862165.452726:0:6732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787862165.452733:0:6732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a116a8f000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862165.452781:0:6732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a1204b9a40 x1874709246386560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787862165.452819:0:6732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787862165.453107:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862165.453134:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246386688:0@lo:400: 00000100:00100000:2.0:1787862165.453242:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.453342:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386688 00000100:00100000:2.0:1787862165.453352:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386688 00000100:00100000:2.0:1787862165.453410:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862165.453420:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1207792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246386688:12345-0@lo:400: 00000100:00100000:2.0:1787862165.453482:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1207792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246386688:12345-0@lo:400: Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.453490:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787862165.453554:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a120778b40 x1874709246386688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862165.453570:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246386688:0@lo:400: 00000100:00100000:0.0:1787862165.453797:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246386560:0@lo:38: 00000100:00100000:0.0:1787862165.453850:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.454122:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386560 00000100:00100000:2.0:1787862165.454129:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386560 00000100:00100000:2.0:1787862165.454159:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862165.454172:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3326:x1874709246386560:12345-0@lo:38: 00010000:00080000:2.0:1787862165.454217:0:5869:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1787862165.454259:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x391a6cd368cd9991 00000004:00100000:2.0:1787862165.454281:0:5869:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787862165.454323:0:5869:0:(import.c:65:import_set_state_nolock()) ffff89a0056f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862165.454376:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874709246386560:12345-0@lo:38: Request processed in 202us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.454383:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787862165.454419:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a1204b9a40 x1874709246386560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862165.454429:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787862165.454438:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787862165.454447:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787862165.454453:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787862165.454456:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a116a8f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787862165.454461:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246386560:0@lo:38: 00000040:00080000:3.0:1787862165.454738:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787862165.456113:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787862165.456157:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862165.456200:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.456216:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787862165.456287:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787862165.456290:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787862165.456291:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862165.456292:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862165.456300:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862165.456301:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862165.456303:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862165.456304:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787862165.456306:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787862165.456308:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862165.456309:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787862165.456313:0:6707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787862165.456315:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787862165.456316:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787862165.456317:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862165.456318:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862165.456319:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862165.456320:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862165.456321:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862165.456322:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787862165.456322:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787862165.456323:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862165.456324:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787862165.456361:0:6707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787862165.456396:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386816:0@lo:253: 00000100:00100000:3.0:1787862165.456497:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862165.456557:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386816 00000100:00100000:3.0:1787862165.456566:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386816 00000100:00100000:3.0:1787862165.456616:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787862165.456626:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6707:x1874709246386816:12345-0@lo:253: 20000000:01000000:3.0:1787862165.456672:0:5862:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787862165.456689:0:5862:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787862165.457524:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a120664540 going to sleep for 11 seconds 20000000:01000000:3.0:1787862165.534468:0:5862:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787862165.534491:0:5862:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787862165.534519:0:5884:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787862165.534527:0:5884:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787862165.534557:0:5884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.534608:0:5884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.534619:0:5884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.534676:0:5884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.534695:0:5884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 13 pid: 5862 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862165.534714:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5884:1874709246386944:0@lo:104: 00000100:00100000:2.0:1787862165.534834:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.534917:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103f25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862165.535030:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246386944 00000100:00100000:0.0:1787862165.535064:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246386944 00000100:00100000:0.0:1787862165.535127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862165.535138:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5884:x1874709246386944:12345-0@lo:104: 00010000:00010000:0.0:1787862165.535156:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862165.535240:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862165.535248:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5884:x1874709246386944:12345-0@lo:104: Request processed in 112us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862165.535256:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787862165.535757:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5884:1874709246386944:0@lo:104: 00010000:00010000:2.0:1787862165.535787:0:5884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.537338:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862165.537356:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.537370:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862165.537397:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.537412:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862165.537421:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862165.537427:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862165.537553:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.537562:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862165.537601:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.537611:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd98e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd98f0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862165.537636:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862165.537638:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862165.537640:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862165.537824:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862165.537851:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246387072:0@lo:103: 00000100:00100000:2.0:1787862165.537966:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862165.538088:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387072 00000100:00100000:2.0:1787862165.538098:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387072 00010000:00010000:2.0:1787862165.538156:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 14 pid: 5862 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862165.539687:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787862165.539712:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a119230c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3330:x1874709246387072:12345-0@lo:103: 00010000:00010000:2.0:1787862165.539756:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862165.539768:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 14 pid: 5862 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539788:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 14 pid: 5862 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539814:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a8600/0x391a6cd368cd98f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd98e9 expref: 14 pid: 5862 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539833:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539842:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787862165.539865:0:5855:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005338756s 00010000:00010000:2.0:1787862165.539870:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539878:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539885:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539894:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539901:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b210800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862165.539906:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539923:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539953:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862165.539966:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862165.540094:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a119230c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3330:x1874709246387072:12345-0@lo:103: Request processed in 395us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862165.540105:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787862165.540130:0:5884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.540143:0:5884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862165.540150:0:5884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9998 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862165.542456:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246387072:0@lo:103: 00000100:00100000:3.0:1787862165.558004:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:6707:x1874709246386816:12345-0@lo:253: Request processed in 101353us (101480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862165.558023:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787862165.558684:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6707:1874709246386816:0@lo:253: 10000000:01000000:1.0:1787862165.558704:0:6707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787862165.558708:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787862165.558710:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787862165.558712:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862165.558713:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862165.558715:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862165.558717:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862165.558794:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862165.558797:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862165.558798:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862165.558800:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862165.558802:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787862165.558825:0:6707:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787862165.574387:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862165.574651:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862165.574929:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862165.575173:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862165.575411:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862165.575589:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787862165.583577:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787862165.653306:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787862165.984666:0:6707:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787862165.984676:0:6707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787862165.984715:0:6707:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787862165.984790:0:6707:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787862165.984818:0:6707:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787862165.984848:0:6707:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787862166.660272:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862167.685263:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862168.708396:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862169.733445:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862170.125949:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787862170.125958:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a102b43800 from 21 10000000:01000000:2.0:1787862170.125965:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862170.126021:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.126035:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.126095:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862170.126131:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387200:0@lo:101: 00000100:00100000:2.0:1787862170.126213:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.126275:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862170.128329:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387200 00000100:00100000:3.0:1787862170.128346:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387200 00000100:00100000:3.0:1787862170.128426:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787862170.128438:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246387200:12345-0@lo:101: 00010000:00010000:3.0:1787862170.128475:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862170.128498:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd999f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862170.128533:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd999f expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862170.128555:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd999f expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862170.128567:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:3.0:1787862170.128661:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246387200:12345-0@lo:101: Request processed in 225us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862170.128668:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787862170.128795:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387200:0@lo:101: 00010000:00010000:2.0:1787862170.128819:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.128831:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862170.128909:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387328:0@lo:501: 00000100:00100000:2.0:1787862170.128949:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.128992:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862170.129130:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387328 00000100:00100000:1.0:1787862170.129136:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387328 00000100:00100000:1.0:1787862170.129176:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787862170.129183:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246387328:12345-0@lo:501: 00000100:00100000:1.0:1787862170.129597:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246387328:12345-0@lo:501: Request processed in 412us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.129605:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862170.129697:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387328:0@lo:501: 00000100:00100000:2.0:1787862170.129729:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387456:0@lo:503: 00000100:00100000:2.0:1787862170.129783:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.129810:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862170.129909:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387456 00000100:00100000:1.0:1787862170.129914:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387456 00000100:00100000:1.0:1787862170.129944:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787862170.129950:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246387456:12345-0@lo:503: 00000100:00100000:1.0:1787862170.130321:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246387456:12345-0@lo:503: Request processed in 369us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.130338:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787862170.130379:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387456:0@lo:503: 00000100:00100000:1.0:1787862170.140196:0:6905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6905:1874709246387584:0@lo:502: 00000100:00100000:1.0:1787862170.140324:0:6905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.140372:0:6905:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862170.140463:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387584 00000100:00100000:3.0:1787862170.140472:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387584 00000100:00100000:3.0:1787862170.140528:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787862170.140538:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6905:x1874709246387584:12345-0@lo:502: 00000100:00100000:3.0:1787862170.140913:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6905:x1874709246387584:12345-0@lo:502: Request processed in 373us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862170.140922:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862170.141942:0:6905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6905:1874709246387584:0@lo:502: 00000100:00100000:1.0:1787862170.142026:0:6905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6905:1874709246387712:0@lo:502: 00000100:00100000:1.0:1787862170.142397:0:6905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.142861:0:6905:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862170.151597:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387712 00000100:00100000:2.0:1787862170.151614:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387712 00000100:00100000:2.0:1787862170.151682:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787862170.151694:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6905:x1874709246387712:12345-0@lo:502: 00000100:00100000:2.0:1787862170.152036:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:6905:x1874709246387712:12345-0@lo:502: Request processed in 343us (9638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862170.152072:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862170.152298:0:6905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6905:1874709246387712:0@lo:502: 00000040:00080000:1.0:1787862170.152342:0:6905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787862170.154147:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787862170.154184:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862170.154197:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.154212:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862170.154222:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787862170.154225:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a102b43800 from 4 10000000:01000000:2.0:1787862170.154228:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862170.154269:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.154279:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.154290:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862170.154313:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387840:0@lo:101: 00000100:00100000:2.0:1787862170.154383:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.154444:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787862170.154520:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387840 00000100:00100000:1.0:1787862170.154528:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387840 00000100:00100000:1.0:1787862170.154593:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787862170.154605:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246387840:12345-0@lo:101: 00010000:00010000:1.0:1787862170.154621:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862170.154637:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd99ad expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.154664:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.154676:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.154686:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9000, rc 0) 00000100:00100000:1.0:1787862170.154745:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246387840:12345-0@lo:101: Request processed in 142us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.154753:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862170.155670:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387840:0@lo:101: 00010000:00010000:2.0:1787862170.155695:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.155707:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862170.155852:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387968:0@lo:256: 00000100:00100000:2.0:1787862170.155907:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.155944:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787862170.155966:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246387968 00000100:00100000:2.0:1787862170.155971:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246387968 00000100:00100000:2.0:1787862170.156009:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862170.156017:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246387968:12345-0@lo:256: 20000000:01000000:2.0:1787862170.156068:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787862170.156089:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787862170.156092:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787862170.156192:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246387968:12345-0@lo:256: Request processed in 175us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862170.156200:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862170.156237:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246387968:0@lo:256: 10000000:01000000:2.0:1787862170.156277:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862170.156289:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156297:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862170.156306:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787862170.156308:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787862170.156311:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787862170.156332:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156349:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156359:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862170.156371:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246388096:0@lo:101: 00000100:00100000:2.0:1787862170.156396:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.156410:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787862170.156421:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388096 00000100:00100000:2.0:1787862170.156425:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388096 00000100:00100000:2.0:1787862170.156446:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862170.156452:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246388096:12345-0@lo:101: 00010000:00010000:2.0:1787862170.156460:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862170.156471:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd99bb expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156490:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156499:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156507:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b210800, rc 0) 00000100:00100000:2.0:1787862170.156536:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246388096:12345-0@lo:101: Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862170.156549:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862170.156579:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246388096:0@lo:101: 00010000:00010000:2.0:1787862170.156595:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862170.156602:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862170.156645:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246388224:0@lo:501: 00000100:00100000:2.0:1787862170.156668:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862170.156679:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787862170.156688:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388224 00000100:00100000:2.0:1787862170.156690:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388224 00000100:00100000:2.0:1787862170.156707:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862170.156711:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246388224:12345-0@lo:501: 00000100:00100000:2.0:1787862170.158360:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246388224:12345-0@lo:501: Request processed in 1638us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862170.158375:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787862170.159222:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246388224:0@lo:501: 00000100:00100000:1.0:1787862170.159298:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246388352:0@lo:503: 00000100:00100000:1.0:1787862170.159367:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.159409:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862170.159555:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388352 00000100:00100000:0.0:1787862170.159562:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388352 00000100:00100000:0.0:1787862170.159616:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787862170.159627:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246388352:12345-0@lo:503: 00000100:00100000:0.0:1787862170.161469:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246388352:12345-0@lo:503: Request processed in 1833us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862170.161484:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787862170.162402:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246388352:0@lo:503: 00000100:00100000:0.0:1787862170.163662:0:6906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6906:1874709246388480:0@lo:502: 00000100:00100000:0.0:1787862170.163757:0:6906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862170.163866:0:6906:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1032c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862170.163917:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388480 00000100:00100000:1.0:1787862170.163924:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388480 00000100:00100000:1.0:1787862170.163978:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787862170.163989:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:6906:x1874709246388480:12345-0@lo:502: 00000100:00100000:1.0:1787862170.164364:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:6906:x1874709246388480:12345-0@lo:502: Request processed in 376us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.164374:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862170.165482:0:6906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6906:1874709246388480:0@lo:502: 00000020:01000000:0.0:1787862170.165533:0:6906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787862170.165541:0:6906:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787862170.165549:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862170.165551:0:6906:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787862170.165559:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787862170.165563:0:6906:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:0.0:1787862170.165589:0:6906:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787862170.165592:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787862170.165611:0:6906:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a13f9a3490) 00000020:00000080:0.0:1787862170.165633:0:6906:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787862170.165639:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787862170.165742:0:6906:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787862170.165750:0:6906:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787862170.165758:0:6906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd99d0 00010000:00080000:0.0:1787862170.166081:0:6906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a102aa5000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1787862170.166355:0:6906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787862170.236834:0:6906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787862170.236861:0:6906:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787862170.238037:0:6906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862170.238322:0:6906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862170.238382:0:6906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787862170.238446:0:6906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787862170.239400:0:6912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862170.239408:0:6912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787862170.240445:0:6906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787862170.240461:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787862170.240498:0:6906:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787862170.240520:0:6906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cd99d7 00000100:00080000:3.0:1787862170.240532:0:6906:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787862170.240538:0:6906:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a102aa5000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862170.240585:0:6906:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a1204bb0c0 x1874709246388608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862170.240726:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246388608:0@lo:8: 00000100:00100000:0.0:1787862170.240819:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.240928:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388608 00000100:00100000:1.0:1787862170.240936:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388608 00000100:00100000:1.0:1787862170.240980:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862170.240989:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3326:x1874709246388608:12345-0@lo:8: 00010000:00080000:1.0:1787862170.241016:0:6709:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1787862170.241063:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cd99de 00002000:00100000:1.0:1787862170.241098:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a141984800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113978 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787862170.241111:0:6709:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787862170.241126:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787862170.241258:0:6709:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787862170.241400:0:6709:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787862170.241426:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a141987000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787862170.241869:0:6906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787862170.241972:0:6906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862170.241979:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862170.241982:0:6906:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787862170.241986:0:6906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862170.241990:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862170.241991:0:6906:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787862170.241994:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787862170.241996:0:6906:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787862170.242030:0:6906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6906:1874709246388736:0@lo:502: 00000100:00100000:3.0:1787862170.242110:0:6906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862170.242156:0:6906:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a007134600 going to sleep for 11 seconds 00000100:00100000:1.0:1787862170.242371:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3326:x1874709246388608:12345-0@lo:8: Request processed in 1380us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.242381:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787862170.242500:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1204bb0c0 x1874709246388608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862170.242514:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862170.242524:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787862170.242533:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787862170.242544:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787862170.242547:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a102aa5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787862170.242695:0:3326:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787862170.242703:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246388608:0@lo:8: 00000100:00100000:0.0:1787862170.242824:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388736 00000100:00100000:0.0:1787862170.242831:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388736 00000100:00100000:0.0:1787862170.242870:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862170.242878:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:6906:x1874709246388736:12345-0@lo:502: 00000100:00100000:0.0:1787862170.243312:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:6906:x1874709246388736:12345-0@lo:502: Request processed in 434us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862170.243320:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862170.243368:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246388864:0@lo:400: 00000100:00100000:0.0:1787862170.243403:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862170.243455:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246388992:0@lo:400: 00000100:00100000:0.0:1787862170.243482:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862170.243535:0:6906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:6906:1874709246388736:0@lo:502: 00000020:01000000:0.0:1787862170.243569:0:6906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862170.243577:0:6906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862170.243579:0:6906:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787862170.243588:0:6906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1787862170.243779:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388864 00000100:00100000:2.0:1787862170.243785:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388864 00000100:00100000:2.0:1787862170.243819:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246388992 00000100:00100000:2.0:1787862170.243822:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246388992 00000100:00100000:2.0:1787862170.243848:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787862170.243855:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246388864:12345-0@lo:400: 00000100:00100000:2.0:1787862170.243906:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246388864:12345-0@lo:400: Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862170.243913:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787862170.243926:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787862170.243933:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246388992:12345-0@lo:400: 00000100:00100000:2.0:1787862170.243965:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246388992:12345-0@lo:400: Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862170.243978:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787862170.243997:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1204630c0 x1874709246388864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787862170.244003:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862170.244009:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246388864:0@lo:400: 00010000:00080000:0.0:1787862170.244032:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120463480 x1874709246388992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862170.244068:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246388992:0@lo:400: 00000020:01000000:1.0:1787862170.244235:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787862170.244259:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787862170.244271:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.244283:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862170.244293:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787862170.244296:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89a108763490 from 1 10000000:01000000:1.0:1787862170.244299:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787862170.244332:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.244339:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.244349:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862170.244364:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246389120:0@lo:101: 00000100:00100000:1.0:1787862170.244407:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.244441:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1032c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862170.244729:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389120 00000100:00100000:0.0:1787862170.244735:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389120 00000100:00100000:0.0:1787862170.244888:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862170.244897:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246389120:12345-0@lo:101: 00010000:00010000:0.0:1787862170.244906:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862170.245031:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd99e5 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862170.245097:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862170.245110:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862170.245130:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030c00, rc 0) 00000100:00100000:0.0:1787862170.245174:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246389120:12345-0@lo:101: Request processed in 278us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862170.245181:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787862170.245731:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246389120:0@lo:101: 00010000:00010000:1.0:1787862170.245762:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862170.245780:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862170.245839:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246389248:0@lo:501: 00000100:00100000:1.0:1787862170.245876:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.245902:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1032c93c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787862170.247905:0:6912:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787862170.249474:0:6912:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221284431472ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787862170.250019:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389248 00000100:00100000:0.0:1787862170.250030:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389248 00000100:00100000:0.0:1787862170.250102:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862170.250114:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246389248:12345-0@lo:501: 00000100:00100000:0.0:1787862170.250406:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246389248:12345-0@lo:501: Request processed in 293us (4527us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787862170.250415:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862170.250492:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246389248:0@lo:501: 10000000:01000000:0.0:1787862170.250537:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787862170.250548:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862170.250566:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862170.301997:0:6913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787862170.302064:0:6913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246389504:0@lo:7: 00000100:00100000:1.0:1787862170.302172:0:6913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.302234:0:6913:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a120664540 going to sleep for 11 seconds 00000100:00100000:1.0:1787862170.302264:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389504 00000100:00100000:1.0:1787862170.302272:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389504 00000100:00100000:2.0:1787862170.302455:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246389376:0@lo:13: 00000100:00100000:2.0:1787862170.302498:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.302849:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862170.302917:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120583840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6913:x1874709246389504:12345-0@lo:7: 00000100:00080000:2.0:1787862170.303478:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862170.311638:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389376 00000100:00100000:1.0:1787862170.311658:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389376 00000100:00100000:1.0:1787862170.311863:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862170.311877:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1207783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246389376:12345-0@lo:13: 00002000:00000024:1.0:1787862170.311924:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787862170.312029:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1207783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246389376:12345-0@lo:13: Request processed in 156us (9529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.312066:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787862170.312172:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1205812c0 x1874709246389376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862170.312196:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246389376:0@lo:13: 00002000:00080000:1.0:1787862170.332409:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787862170.332418:0:6712:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787862170.332660:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120583840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6913:x1874709246389504:12345-0@lo:7: Request processed in 29680us (30420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.332676:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787862170.334255:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120580f00 x1874709246389504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787862186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862170.334282:0:6913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246389504:0@lo:7: 00000004:00080000:0.0:1787862170.334447:0:6913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787862170.334573:0:6913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246389632:0@lo:5: 00000100:00100000:1.0:1787862170.337729:0:6913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.337812:0:6913:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11170ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862170.338019:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389632 00000100:00100000:0.0:1787862170.338032:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389632 00000100:00100000:0.0:1787862170.338146:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862170.338158:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6913:x1874709246389632:12345-0@lo:5: 00002000:00080000:0.0:1787862170.338197:0:6709:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787862170.338202:0:6709:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787862170.341217:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6913:x1874709246389632:12345-0@lo:5: Request processed in 3052us (3487us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787862170.341233:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787862170.341328:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120463480 x1874709246389632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862170.341349:0:6913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246389632:0@lo:5: 00000004:00080000:3.0:1787862170.341368:0:6913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787862170.341416:0:6913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246389760:0@lo:700: 00000100:00100000:3.0:1787862170.341459:0:6913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862170.341506:0:6913:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a007134840 going to sleep for 11 seconds 00000100:00100000:0.0:1787862170.343550:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389760 00000100:00100000:0.0:1787862170.343565:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389760 00000100:00100000:0.0:1787862170.343624:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862170.343634:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6913:x1874709246389760:12345-0@lo:700: 00000100:00100000:0.0:1787862170.343689:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204630c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6718:1874709246389888:0@lo:700: 00000100:00100000:0.0:1787862170.343738:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862170.343768:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11170e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862170.343814:0:5875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246389888 00000100:00100000:0.0:1787862170.343823:0:5875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246389888 00000100:00100000:0.0:1787862170.343853:0:5875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862170.343859:0:5875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6718:x1874709246389888:12345-0@lo:700: 00000004:00080000:2.0:1787862170.365708:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787862170.409198:0:5875:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787862170.423104:0:5875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6718:x1874709246389888:12345-0@lo:700: Request processed in 79229us (79350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862170.423135:0:5875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787862170.423470:0:6718:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1204630c0 x1874709246389888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787862186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862170.423488:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204630c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6718:1874709246389888:0@lo:700: 40000000:02000000:2.0:1787862170.423505:0:6718:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1787862170.558704:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6913:x1874709246389760:12345-0@lo:700: Request processed in 215057us (217230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862170.558728:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1787862170.558918:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787862170.558938:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787862170.558987:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1204ba580 x1874709246389760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787862186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862170.559007:0:6913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246389760:0@lo:700: 00000004:02000040:1.0:1787862170.622507:0:6913:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787862170.625349:0:6913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246390016:0@lo:5: 00000100:00100000:1.0:1787862170.625434:0:6913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862170.625499:0:6913:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028e33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862170.625705:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390016 00000100:00100000:0.0:1787862170.625714:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390016 00000100:00100000:0.0:1787862170.625785:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862170.625796:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6913:x1874709246390016:12345-0@lo:5: 00002000:00080000:0.0:1787862170.631561:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787862170.631586:0:6712:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787862170.635178:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6913:x1874709246390016:12345-0@lo:5: Request processed in 9374us (9734us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787862170.635194:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787862170.635395:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1205812c0 x1874709246390016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862170.635412:0:6913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787862170.635433:0:6913:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89a1205812c0 x1874709246390016/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862186 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862170.635461:0:6913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1874709246390016:0@lo:5: 00000004:00080000:1.0:1787862170.635480:0:6913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787862170.767198:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862171.781231:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862172.810110:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862173.527823:0:7079:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787862173.834081:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862174.853008:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862175.748396:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246390144:0@lo:13: 00000100:00100000:2.0:1787862175.748493:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862175.748882:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390144 00000100:00100000:3.0:1787862175.748894:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390144 00000100:00100000:3.0:1787862175.748968:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862175.748979:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246390144:12345-0@lo:13: 00002000:00000024:3.0:1787862175.749021:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862175.749113:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246390144:12345-0@lo:13: Request processed in 135us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862175.749131:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787862175.749183:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1204ba940 x1874709246390144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862175.749204:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246390144:0@lo:13: 00000100:00080000:2.0:1787862175.751964:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862175.764884:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862175.764917:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246390272:0@lo:400: 00000100:00100000:0.0:1787862175.765004:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862175.765099:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246390400:0@lo:400: 00000100:00100000:0.0:1787862175.765133:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862175.765157:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862175.765162:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246390528:0@lo:400: 00000100:00100000:0.0:1787862175.765203:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862175.765239:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390272 00000100:00100000:0.0:1787862175.765246:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390272 00000100:00100000:0.0:1787862175.765295:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787862175.765306:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3329:x1874709246390272:12345-0@lo:400: 00000100:00100000:0.0:1787862175.765366:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3329:x1874709246390272:12345-0@lo:400: Request processed in 61us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862175.765375:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787862175.765427:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390400 00000100:00100000:0.0:1787862175.765430:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390400 00000100:00100000:0.0:1787862175.765468:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390528 00000100:00100000:0.0:1787862175.765471:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390528 00000100:00100000:0.0:1787862175.765494:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862175.765500:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1137a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246390400:12345-0@lo:400: 00000100:00100000:0.0:1787862175.765534:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1137a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246390400:12345-0@lo:400: Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862175.765541:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862175.765552:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862175.765558:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246390528:12345-0@lo:400: 00000100:00100000:0.0:1787862175.765585:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246390528:12345-0@lo:400: Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862175.765590:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862175.765630:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246390272:0@lo:400: 00000100:00080000:0.0:1787862175.765654:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862175.766178:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1204630c0 x1874709246390528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862175.766198:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246390528:0@lo:400: 00010000:00080000:0.0:1787862175.766213:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120463480 x1874709246390400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862175.766221:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246390400:0@lo:400: 00010000:00010000:0.0:1787862175.878775:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787862175.879128:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787862176.900647:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862177.933173:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862178.949195:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862179.974567:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862180.871971:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120581a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246390656:0@lo:400: 00000100:00100000:0.0:1787862180.872122:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862180.872202:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862180.872211:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246390784:0@lo:400: 00000100:00100000:0.0:1787862180.872244:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862180.872283:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246390912:0@lo:400: 00000100:00100000:0.0:1787862180.872308:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862180.872328:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862180.872334:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246391040:0@lo:400: 00000100:00100000:0.0:1787862180.872360:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862180.872428:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390656 00000100:00100000:0.0:1787862180.872436:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390656 00000100:00100000:0.0:1787862180.872489:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862180.872497:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3329:x1874709246390656:12345-0@lo:400: 00000100:00100000:0.0:1787862180.872561:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3329:x1874709246390656:12345-0@lo:400: Request processed in 64us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862180.872569:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862180.872607:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390784 00000100:00100000:0.0:1787862180.872611:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390784 00000100:00100000:0.0:1787862180.872636:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246390912 00000100:00100000:0.0:1787862180.872638:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246390912 00000100:00100000:0.0:1787862180.872667:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862180.872673:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246390784:12345-0@lo:400: 00000100:00100000:0.0:1787862180.872708:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246390784:12345-0@lo:400: Request processed in 34us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862180.872714:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862180.872742:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862180.872747:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246390912:12345-0@lo:400: 00000100:00100000:0.0:1787862180.872782:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246390912:12345-0@lo:400: Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862180.872788:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862180.872808:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391040 00000100:00100000:0.0:1787862180.872811:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391040 00000100:00100000:0.0:1787862180.872838:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862180.872844:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246391040:12345-0@lo:400: 00000100:00100000:0.0:1787862180.872873:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246391040:12345-0@lo:400: Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862180.872879:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787862180.872903:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862180.872908:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862180.872945:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120582d00 x1874709246391040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862180.872959:0:3327:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787862180.872978:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246391040:0@lo:400: 00010000:00080000:0.0:1787862180.872991:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120582580 x1874709246390912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862180.873000:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246390912:0@lo:400: 00010000:00080000:0.0:1787862180.873430:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1205821c0 x1874709246390784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862180.873440:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246390784:0@lo:400: 00000100:00100000:0.0:1787862180.873449:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120581a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246390656:0@lo:400: 00000100:00100000:0.0:1787862180.878866:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862180.878899:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246391168:0@lo:13: 00000100:00100000:0.0:1787862180.879030:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862180.880317:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391168 00000100:00100000:3.0:1787862180.880336:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391168 00000100:00100000:3.0:1787862180.880423:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862180.880437:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246391168:12345-0@lo:13: 00002000:00000024:3.0:1787862180.880497:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862180.880614:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246391168:12345-0@lo:13: Request processed in 179us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862180.880621:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787862180.880682:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13c4cb0c0 x1874709246391168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862180.880706:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246391168:0@lo:13: 00010000:00010000:2.0:1787862180.998304:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862182.020821:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862183.046313:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862184.068298:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862185.095282:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862185.989114:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862185.989146:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246391296:0@lo:13: 00000100:00100000:1.0:1787862185.989233:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862185.989304:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391296 00000100:00100000:1.0:1787862185.989314:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391296 00000100:00100000:1.0:1787862185.989377:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862185.989387:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120581e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246391296:12345-0@lo:13: 00002000:00000024:1.0:1787862185.989430:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862185.989482:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120581e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246391296:12345-0@lo:13: Request processed in 96us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862185.989490:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787862185.989515:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787862185.989551:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120580b40 x1874709246391296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862185.989575:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246391296:0@lo:13: 00000100:00100000:0.0:1787862185.989778:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862185.989789:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246391680:0@lo:400: 00000100:00100000:0.0:1787862185.989827:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862185.989853:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391680 00000100:00100000:0.0:1787862185.989856:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391680 00000100:00100000:0.0:1787862185.989942:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862185.990019:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246391680:12345-0@lo:400: 00000100:00100000:0.0:1787862185.990086:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246391680:12345-0@lo:400: Request processed in 135us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862185.990093:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787862185.990120:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13c4c9e00 x1874709246391680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862185.990130:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246391680:0@lo:400: 00000100:00100000:2.0:1787862185.990194:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246391552:0@lo:400: 00000100:00100000:2.0:1787862185.990224:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862185.990253:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862185.990275:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246391424:0@lo:400: 00000100:00100000:2.0:1787862185.990306:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862185.990341:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391424 00000100:00100000:2.0:1787862185.990346:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391424 00000100:00100000:2.0:1787862185.990376:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862185.990383:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3328:x1874709246391424:12345-0@lo:400: 00000100:00100000:2.0:1787862185.990418:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3328:x1874709246391424:12345-0@lo:400: Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862185.990424:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862185.990460:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246391424:0@lo:400: 00000100:00080000:1.0:1787862185.990658:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862185.991277:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391552 00000100:00100000:0.0:1787862185.991285:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391552 00000100:00100000:0.0:1787862185.991352:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862185.991360:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246391552:12345-0@lo:400: 00000100:00100000:0.0:1787862185.991428:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246391552:12345-0@lo:400: Request processed in 68us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862185.991436:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787862185.991520:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13c4c9680 x1874709246391552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862185.991532:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246391552:0@lo:400: 00010000:00010000:3.0:1787862186.119085:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862187.141272:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787862187.801302:0:7644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787862187.801310:0:7644:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787862187.801482:0:7644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89a102aa4000 00000020:01000004:0.0:1787862187.801508:0:7644:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787862187.801526:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787862187.801542:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89a13f9a1a48) 00000020:00000080:0.0:1787862187.801563:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787862187.850255:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787862187.850526:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787862187.907142:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787862187.916901:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787862187.916961:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787862187.917021:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787862187.917118:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787862187.917523:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787862187.917539:0:7644:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787862187.917550:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x391a6cd368cd99fa 00000020:01000004:3.0:1787862187.917559:0:7644:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787862187.917587:0:7644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787862187.917592:0:7644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787862187.917677:0:7644:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787862187.917710:0:7644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787862187.917715:0:7644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787862187.987736:0:7644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787862187.987811:0:7644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.109@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787862187.987816:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787862187.987818:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862187.987820:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862187.987821:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862187.987822:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862187.987823:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862187.987825:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862187.987827:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787862187.987828:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787862187.987831:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862187.987832:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787862187.987838:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787862187.987841:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787862187.987842:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862187.987843:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862187.987844:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862187.987845:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862187.987846:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862187.987848:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862187.987849:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787862187.987850:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787862187.987851:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862187.987852:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787862187.987891:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787862187.987919:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246391808:0@lo:253: 00000100:00100000:0.0:1787862187.988220:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862187.988347:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103f25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862187.990657:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391808 00000100:00100000:2.0:1787862187.990678:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391808 00000100:00100000:2.0:1787862187.990754:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862187.990766:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:7644:x1874709246391808:12345-0@lo:253: 20000000:01000000:2.0:1787862187.990808:0:5860:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787862187.990815:0:5860:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787862187.990821:0:5860:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787862187.990825:0:5860:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787862187.997857:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862187.998171:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787862187.998189:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787862187.998231:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787862187.998239:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787862187.998271:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787862187.998326:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787862187.998735:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787862187.998762:0:5860:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:3.0:1787862187.998765:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:3.0:1787862187.998799:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787862187.998807:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787862187.998861:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787862187.998870:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:3.0:1787862187.998901:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787862187.998918:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787862187.998979:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787862187.999024:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787862188.009904:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787862188.011565:0:5860:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:3.0:1787862188.011572:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:3.0:1787862188.012833:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787862188.012865:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787862188.012906:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787862188.012914:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:3.0:1787862188.012968:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787862188.012981:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787862188.014215:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787862188.014309:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787862188.014338:0:5860:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787862188.014342:0:5860:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787862188.014348:0:5860:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787862188.014371:0:5860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787862188.014374:0:5860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787862188.014435:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787862188.014437:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862188.024572:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862188.024756:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862188.024794:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787862188.025422:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787862188.025474:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787862188.025567:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787862188.025587:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787862188.025698:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787862188.027825:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787862188.027928:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787862188.027994:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787862188.028497:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787862188.028538:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787862188.028567:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787862188.028582:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787862188.028585:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787862188.029084:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787862188.029414:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787862188.029449:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787862188.029511:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787862188.029522:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787862188.029524:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862188.030334:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862188.030398:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862188.030442:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787862188.030780:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787862188.030815:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787862188.030864:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787862188.030881:0:5860:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787862188.030884:0:5860:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787862188.030897:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787862188.030918:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.030938:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd994b expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.030947:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031035:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd999f expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031243:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031250:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031270:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031318:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031335:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 16 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.031352:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246391936:0@lo:104: 00000100:00100000:0.0:1787862188.031438:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862188.031529:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031538:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 16 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.031548:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392064:0@lo:104: 00010000:00010000:0.0:1787862188.031595:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd999f expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031614:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd999f expref: 16 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.031622:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392192:0@lo:104: 00010000:00010000:0.0:1787862188.031647:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031654:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 16 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.031670:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392320:0@lo:104: 00010000:00010000:0.0:1787862188.031695:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd994b expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.031702:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd994b expref: 16 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.031710:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392448:0@lo:104: 00000100:00100000:0.0:1787862188.031727:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103f256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862188.031856:0:5851:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787862188.031878:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.031971:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.032113:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862188.032244:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246391936 00000100:00100000:0.0:1787862188.032252:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246391936 00000100:00100000:0.0:1787862188.032293:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392064 00000100:00100000:0.0:1787862188.032295:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392064 00000100:00100000:0.0:1787862188.032303:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392192 00000100:00100000:0.0:1787862188.032304:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392192 00000100:00100000:0.0:1787862188.032317:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862188.032325:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a107e67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5860:x1874709246391936:12345-0@lo:104: 00010000:00010000:0.0:1787862188.032341:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032441:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862188.032448:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a107e67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:5860:x1874709246391936:12345-0@lo:104: Request processed in 123us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.032456:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862188.032510:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862188.032516:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:5860:x1874709246392064:12345-0@lo:104: 00010000:00010000:0.0:1787862188.032524:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032562:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787862188.032567:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:5860:x1874709246392064:12345-0@lo:104: Request processed in 52us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.032572:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862188.032584:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862188.032590:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5860:x1874709246392192:12345-0@lo:104: 00010000:00010000:0.0:1787862188.032597:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032634:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787862188.032638:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5860:x1874709246392192:12345-0@lo:104: Request processed in 49us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.032643:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787862188.032659:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787862188.032665:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032672:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9600 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862188.032676:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032684:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862188.032691:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862188.032696:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787862188.032735:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032741:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862188.032759:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032766:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9600/0x391a6cd368cd99e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99ec expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032777:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862188.032781:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032787:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b211000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862188.032790:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032796:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862188.032802:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862188.032807:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787862188.032817:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032823:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862188.032837:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032858:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b211000/0x391a6cd368cd99bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99c2 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032868:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862188.032870:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032875:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b210c00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862188.032877:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032883:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862188.032888:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862188.032893:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787862188.032904:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032910:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862188.032914:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032920:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd999f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99a6 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.032929:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862188.032936:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862188.032939:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862188.033103:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862188.033114:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862188.033131:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246392576:0@lo:103: 00000100:00100000:1.0:1787862188.033174:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.033218:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246392704:0@lo:103: 00000100:00100000:1.0:1787862188.033242:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.033270:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862188.033276:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246392832:0@lo:103: 00000100:00100000:1.0:1787862188.033298:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.033324:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392576 00000100:00100000:1.0:1787862188.033330:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392576 00010000:00010000:1.0:1787862188.033353:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 17 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.033370:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392704 00000100:00100000:1.0:1787862188.033372:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392704 00010000:00010000:1.0:1787862188.033383:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 18 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.033392:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392832 00000100:00100000:1.0:1787862188.033395:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392832 00010000:00010000:1.0:1787862188.033405:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd999f expref: 19 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.033416:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862188.033422:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246392576:12345-0@lo:103: 00010000:00010000:1.0:1787862188.033434:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862188.033438:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 19 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.033450:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 19 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.033470:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862188.033500:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246392576:12345-0@lo:103: Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.033506:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862188.033528:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862188.033534:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:3327:x1874709246392704:12345-0@lo:103: 00010000:00010000:1.0:1787862188.033541:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862188.033546:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 18 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.033555:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 18 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.033564:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862188.033589:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:3327:x1874709246392704:12345-0@lo:103: Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.033595:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862188.033606:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862188.033612:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120581a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:3327:x1874709246392832:12345-0@lo:103: 00010000:00010000:1.0:1787862188.033618:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862188.033622:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd999f expref: 17 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.033630:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd999f expref: 17 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.033638:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862188.033656:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120581a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:3327:x1874709246392832:12345-0@lo:103: Request processed in 44us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.033661:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862188.033698:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246392832:0@lo:103: 00000100:00100000:1.0:1787862188.033706:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246392704:0@lo:103: 00000100:00100000:1.0:1787862188.033738:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246392576:0@lo:103: 00000100:00100000:2.0:1787862188.036885:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862188.037034:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030c00/0x391a6cd368cd99ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd99e5 expref: 16 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862188.037090:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246391936:0@lo:104: 00010000:00010000:3.0:1787862188.037684:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210800/0x391a6cd368cd99c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd99bb expref: 15 pid: 5860 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862188.037699:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392064:0@lo:104: 00010000:00010000:3.0:1787862188.037712:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd99a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd999f expref: 14 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862188.037721:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392192:0@lo:104: 00000100:00100000:0.0:1787862188.037884:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392320 00000100:00100000:0.0:1787862188.037893:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392320 00000100:00100000:0.0:1787862188.037945:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392448 00000100:00100000:0.0:1787862188.037948:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392448 00000100:00100000:0.0:1787862188.038413:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862188.038426:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:5860:x1874709246392320:12345-0@lo:104: 00010000:00010000:0.0:1787862188.038447:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.038671:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862188.038679:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:5860:x1874709246392320:12345-0@lo:104: Request processed in 256us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.038687:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862188.038711:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862188.038718:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5860:x1874709246392448:12345-0@lo:104: 00010000:00010000:0.0:1787862188.038726:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862188.038796:0:5851:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787862188.038808:0:5851:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787862188.039299:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392320:0@lo:104: 00000100:00100000:3.0:1787862188.039311:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874709246392448:0@lo:104: 00010000:00010000:3.0:1787862188.039346:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039475:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862188.039483:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039491:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862188.039496:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039504:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862188.039511:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862188.039516:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862188.039573:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039580:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787862188.039691:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246392960:0@lo:103: 00000100:00100000:3.0:1787862188.039747:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862188.039853:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039862:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd997c expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039876:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862188.039880:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039897:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031e00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862188.039899:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039907:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862188.039912:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862188.039917:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862188.039937:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.039943:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787862188.039995:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246393088:0@lo:103: 00000100:00100000:2.0:1787862188.040025:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862188.040254:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787862188.040264:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5860:x1874709246392448:12345-0@lo:104: Request processed in 1545us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.040273:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787862188.040326:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862188.040437:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040445:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd994b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9952 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040463:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862188.040465:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862188.040467:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862188.040481:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246392960 00000100:00100000:1.0:1787862188.040488:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246392960 00010000:00010000:1.0:1787862188.040512:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 14 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.040542:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393088 00000100:00100000:1.0:1787862188.040551:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393088 00010000:00010000:1.0:1787862188.040563:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd994b expref: 15 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.040577:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787862188.040585:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:3329:x1874709246392960:12345-0@lo:103: 00010000:00010000:1.0:1787862188.040597:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862188.040678:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 15 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040690:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 15 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040705:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2da00/0x391a6cd368cd997c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9975 expref: 15 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040719:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862188.040758:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3329:x1874709246392960:12345-0@lo:103: Request processed in 174us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.040764:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787862188.040778:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787862188.040783:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3330:x1874709246393088:12345-0@lo:103: 00010000:00010000:1.0:1787862188.040790:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862188.040794:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd994b expref: 13 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040801:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd994b expref: 13 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040809:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd994b expref: 13 pid: 5863 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040827:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040835:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040852:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040860:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040867:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040873:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040878:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862188.040881:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.040889:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862188.041268:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246392960:0@lo:103: 00010000:00010000:3.0:1787862188.041461:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.041471:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787862188.041481:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1787862188.041615:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.041626:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.041655:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862188.041711:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3330:x1874709246393088:12345-0@lo:103: Request processed in 927us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.041720:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787862188.041859:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246393088:0@lo:103: 00010000:00010000:0.0:1787862188.164265:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862188.168146:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:7644:x1874709246391808:12345-0@lo:253: Request processed in 177363us (179907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862188.168166:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862188.168450:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246391808:0@lo:253: 10000000:01000000:0.0:1787862188.168471:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787862188.168476:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862188.168478:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862188.168498:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862188.168499:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787862188.168501:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862188.168503:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862188.168505:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862188.168507:0:7644:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787862188.168509:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862188.168512:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787862188.168544:0:7644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a102aa4000 from lustre-OST0001 10000000:01000000:0.0:1787862188.168580:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787862188.168584:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787862188.168607:0:7644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a108763490 local copy 10000000:01000000:0.0:1787862188.168613:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787862188.168664:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.168676:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.168686:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.168713:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393216:0@lo:101: 00000100:00100000:0.0:1787862188.168767:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862188.168839:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862188.169037:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393216 00000100:00100000:3.0:1787862188.169072:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393216 00000100:00100000:3.0:1787862188.169115:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787862188.169132:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:7644:x1874709246393216:12345-0@lo:101: 00010000:00010000:3.0:1787862188.169148:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862188.169165:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd9a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a08 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.169190:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd9a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a08 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.169202:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd9a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a08 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.169211:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:3.0:1787862188.169260:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393216:12345-0@lo:101: Request processed in 129us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862188.169267:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787862188.169364:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393216:0@lo:101: 00010000:00010000:1.0:1787862188.169382:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.169391:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.169525:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393344:0@lo:501: 00000100:00100000:1.0:1787862188.169557:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.169590:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862188.169744:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393344 00000100:00100000:3.0:1787862188.169750:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393344 00000100:00100000:3.0:1787862188.169784:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787862188.169790:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393344:12345-0@lo:501: 00000100:00100000:3.0:1787862188.170082:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393344:12345-0@lo:501: Request processed in 291us (524us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862188.170092:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787862188.170173:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393344:0@lo:501: 10000000:01000000:1.0:1787862188.170192:0:7644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787862188.170220:0:7644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787862188.170226:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.170235:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.170242:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.170271:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862188.170305:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a102aa4000 10000000:01000000:1.0:1787862188.170310:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787862188.170317:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787862188.170319:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862188.170325:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787862188.170328:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787862188.170332:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862188.170339:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.170346:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030400 already unused, calling callback (ffffffffc1c25c20) 00010000:00010000:1.0:1787862188.170349:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862188.170350:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.170356:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.170359:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.170364:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862188.170367:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862188.170373:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787862188.170376:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393472:0@lo:101: 00010000:00010000:2.0:1787862188.170394:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.170400:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787862188.170403:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787862188.170424:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.170440:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030400/0x391a6cd368cd9a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x391a6cd368cd9a0f expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.170455:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862188.170456:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787862188.170457:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862188.170459:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862188.170469:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246393600:0@lo:103: 00000100:00100000:3.0:1787862188.170500:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.170581:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862188.170850:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393600 00000100:00100000:2.0:1787862188.170856:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393600 00000100:00100000:2.0:1787862188.170906:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862188.170914:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3328:x1874709246393600:12345-0@lo:103: 00010000:00010000:2.0:1787862188.170927:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862188.170941:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2c400/0x391a6cd368cd9a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9a08 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.170976:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862188.171013:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:3328:x1874709246393600:12345-0@lo:103: Request processed in 100us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862188.171021:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862188.171113:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246393600:0@lo:103: 00000100:00100000:3.0:1787862188.179668:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393472 00000100:00100000:3.0:1787862188.179688:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393472 00000100:00100000:3.0:1787862188.179768:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787862188.179780:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+11:7644:x1874709246393472:12345-0@lo:101: 00010000:00010000:3.0:1787862188.179822:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862188.179847:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a16 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.179883:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.179897:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.179907:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d600, rc 0) 00000100:00100000:2.0:1787862188.180172:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393472:0@lo:101: 00010000:00010000:2.0:1787862188.180197:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.180207:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862188.180262:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393472:12345-0@lo:101: Request processed in 482us (9855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862188.180269:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787862188.180368:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393728:0@lo:501: 00000100:00100000:2.0:1787862188.180426:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.180469:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.180709:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393728 00000100:00100000:0.0:1787862188.180716:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393728 00000100:00100000:0.0:1787862188.180758:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787862188.180765:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393728:12345-0@lo:501: 00000100:00100000:0.0:1787862188.181084:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393728:12345-0@lo:501: Request processed in 319us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.181096:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862188.181276:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393728:0@lo:501: 00000100:00100000:2.0:1787862188.181314:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393856:0@lo:503: 00000100:00100000:2.0:1787862188.181355:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.181385:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862188.182069:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393856 00000100:00100000:3.0:1787862188.182079:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393856 00000100:00100000:3.0:1787862188.182132:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787862188.182141:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393856:12345-0@lo:503: 00000100:00100000:3.0:1787862188.182384:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393856:12345-0@lo:503: Request processed in 243us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862188.182391:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787862188.182529:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393856:0@lo:503: 00000040:00080000:1.0:1787862188.182976:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862188.183133:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393984:0@lo:502: 00000100:00100000:1.0:1787862188.183194:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.183239:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.183371:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246393984 00000100:00100000:0.0:1787862188.183378:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246393984 00000100:00100000:0.0:1787862188.183430:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787862188.183441:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393984:12345-0@lo:502: 00000100:00100000:0.0:1787862188.183646:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246393984:12345-0@lo:502: Request processed in 207us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.183655:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862188.183689:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246393984:0@lo:502: 00000040:00080000:1.0:1787862188.184850:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787862188.184939:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787862188.185000:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787862188.185069:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787862188.185280:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787862188.185339:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787862188.185403:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394112:0@lo:502: 00000100:00100000:1.0:1787862188.185585:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.185616:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.185805:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394112 00000100:00100000:0.0:1787862188.185815:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394112 00000100:00100000:0.0:1787862188.185878:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862188.185889:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246394112:12345-0@lo:502: 00000100:00100000:0.0:1787862188.186151:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246394112:12345-0@lo:502: Request processed in 263us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.186159:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787862188.186621:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394112:0@lo:502: 00000040:00080000:2.0:1787862188.186787:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787862188.186806:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787862188.188703:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787862188.188718:0:7652:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787862188.188728:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862188.188730:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787862188.188736:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862188.188756:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89a111029a48) 00000020:00000080:2.0:1787862188.188784:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787862188.188789:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787862188.188889:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a102aa4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787862188.188899:0:7652:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787862188.188907:0:7652:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x391a6cd368cd9a2b 00010000:00010000:3.0:1787862188.199408:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787862188.199986:0:7652:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787862188.205204:0:7652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787862188.206135:0:7652:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787862188.213880:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787862188.215223:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787862188.218518:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787862188.218536:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862188.218543:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862188.218546:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787862188.218556:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862188.218562:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862188.218564:0:7652:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787862188.218568:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787862188.218569:0:7652:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787862188.218635:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862188.218639:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862188.218641:0:7652:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787862188.218644:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787862188.220784:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787862188.220832:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787862188.220864:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.220882:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862188.220893:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102aa4000 from 1 10000000:01000000:0.0:1787862188.220896:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862188.220965:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.220995:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.221008:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.221057:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394240:0@lo:101: 00000100:00100000:1.0:1787862188.221182:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.221236:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862188.221845:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394240 00000100:00100000:2.0:1787862188.221856:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394240 00000100:00100000:2.0:1787862188.221916:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787862188.221927:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:7644:x1874709246394240:12345-0@lo:101: 00010000:00010000:2.0:1787862188.221945:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862188.221978:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a32 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.222008:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.222028:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.222037:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b210600, rc 0) 00000100:00100000:2.0:1787862188.222123:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394240:12345-0@lo:101: Request processed in 197us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862188.222130:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862188.222440:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394240:0@lo:101: 00010000:00010000:1.0:1787862188.222461:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.222471:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.222620:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394368:0@lo:501: 00000100:00100000:1.0:1787862188.222657:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.222693:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.222811:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394368 00000100:00100000:0.0:1787862188.222818:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394368 00000100:00100000:0.0:1787862188.222857:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862188.222866:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394368:12345-0@lo:501: 00000100:00100000:0.0:1787862188.223379:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394368:12345-0@lo:501: Request processed in 512us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.223386:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787862188.223557:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394368:0@lo:501: 00000100:00100000:1.0:1787862188.223609:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394496:0@lo:503: 00000100:00100000:1.0:1787862188.223658:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.223687:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862188.223708:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394496 00000100:00100000:1.0:1787862188.223712:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394496 00000100:00100000:1.0:1787862188.223740:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787862188.223748:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394496:12345-0@lo:503: 00000100:00100000:1.0:1787862188.224886:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394496:12345-0@lo:503: Request processed in 1128us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.224901:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787862188.225259:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394496:0@lo:503: 00000040:00080000:2.0:1787862188.226381:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862188.227264:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394624:0@lo:502: 00000100:00100000:1.0:1787862188.227429:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.227562:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.228389:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394624 00000100:00100000:0.0:1787862188.228402:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394624 00000100:00100000:0.0:1787862188.228471:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787862188.230086:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394624:12345-0@lo:502: 00000100:00100000:0.0:1787862188.230581:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394624:12345-0@lo:502: Request processed in 2100us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.230593:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787862188.234244:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394624:0@lo:502: 00000040:00080000:3.0:1787862188.234994:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787862188.235101:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787862188.235158:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394752:0@lo:502: 00000100:00100000:3.0:1787862188.235258:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862188.235310:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394752 00000100:00100000:3.0:1787862188.235312:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a111f520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.235317:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394752 00000100:00100000:0.0:1787862188.235377:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787862188.235388:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394752:12345-0@lo:502: 00000100:00100000:0.0:1787862188.235626:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394752:12345-0@lo:502: Request processed in 239us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.235640:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787862188.236629:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394752:0@lo:502: 00000040:00080000:1.0:1787862188.236859:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787862188.236879:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787862188.249139:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862188.249158:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862188.249161:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787862188.249170:0:7656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a102aa4000 00000020:00000080:1.0:1787862188.249173:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787862188.249196:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862188.249200:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862188.249201:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787862188.249205:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787862188.249529:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787862188.249566:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862188.249590:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.249606:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862188.249650:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787862188.249653:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a102aa4000 10000000:01000000:3.0:1787862188.249655:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a102aa4000 10000000:01000000:3.0:1787862188.249659:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787862188.249663:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a102aa4000 from 1 10000000:01000000:3.0:1787862188.249665:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787862188.249704:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.249728:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862188.249739:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862188.249765:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394880:0@lo:101: 00000100:00100000:3.0:1787862188.249853:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862188.249905:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103f25180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.249905:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246394880 00000100:00100000:0.0:1787862188.249915:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246394880 00000100:00100000:0.0:1787862188.250224:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787862188.250239:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246394880:12345-0@lo:101: 00010000:00010000:0.0:1787862188.250256:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862188.250272:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a40 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.250299:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.250310:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862188.250320:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030000, rc 0) 00000100:00100000:0.0:1787862188.250415:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246394880:12345-0@lo:101: Request processed in 179us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.250423:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787862188.250500:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246394880:0@lo:101: 00010000:00010000:1.0:1787862188.250519:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862188.250528:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862188.250646:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395008:0@lo:501: 00000100:00100000:1.0:1787862188.250680:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.250714:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862188.251011:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395008 00000100:00100000:3.0:1787862188.251017:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395008 00000100:00100000:3.0:1787862188.251291:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862188.251301:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395008:12345-0@lo:501: 00000100:00100000:3.0:1787862188.251647:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395008:12345-0@lo:501: Request processed in 347us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862188.251656:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787862188.251732:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395008:0@lo:501: 00000100:00100000:1.0:1787862188.251786:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395136:0@lo:503: 00000100:00100000:1.0:1787862188.251837:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.252764:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.252839:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395136 00000100:00100000:0.0:1787862188.252846:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395136 00000100:00100000:0.0:1787862188.252896:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787862188.252906:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395136:12345-0@lo:503: 00000100:00100000:0.0:1787862188.253499:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395136:12345-0@lo:503: Request processed in 592us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.253507:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787862188.253659:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395136:0@lo:503: 00000040:00080000:1.0:1787862188.254574:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862188.254666:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395264:0@lo:502: 00000100:00100000:1.0:1787862188.254740:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.254820:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862188.254864:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395264 00000100:00100000:3.0:1787862188.254871:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395264 00000100:00100000:3.0:1787862188.255251:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862188.255265:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395264:12345-0@lo:502: 00000100:00100000:3.0:1787862188.255616:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395264:12345-0@lo:502: Request processed in 353us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862188.255624:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787862188.256337:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395264:0@lo:502: 00000040:00080000:2.0:1787862188.256740:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787862188.256815:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787862188.256854:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787862188.256903:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787862188.256942:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787862188.257016:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787862188.257086:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787862188.257123:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787862188.257176:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787862188.257212:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787862188.257266:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787862188.257318:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787862188.257355:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787862188.257389:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787862188.257438:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787862188.257476:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787862188.257526:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787862188.257577:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787862188.257612:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787862188.257645:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787862188.257692:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787862188.257730:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787862188.257766:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787862188.257814:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787862188.257851:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787862188.257885:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787862188.257987:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787862188.258025:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787862188.258092:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787862188.258142:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787862188.258178:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787862188.258213:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787862188.258247:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787862188.258296:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787862188.258331:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787862188.258378:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787862188.258407:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787862188.258465:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395392:0@lo:502: 00000100:00100000:2.0:1787862188.258572:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862188.258914:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395392 00000100:00100000:0.0:1787862188.258923:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395392 00000100:00100000:0.0:1787862188.259026:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787862188.259037:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395392:12345-0@lo:502: 00000100:00100000:0.0:1787862188.259386:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246395392:12345-0@lo:502: Request processed in 349us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.259395:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787862188.260646:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862188.260698:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246395392:0@lo:502: 00000040:00080000:2.0:1787862188.260877:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787862188.260896:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787862188.262923:0:7657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787862188.263125:0:7657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89a0055b1a48) 00000020:00000080:1.0:1787862188.263168:0:7657:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787862188.263288:0:7657:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a102aa4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787862188.263293:0:7657:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a102aa4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787862188.263296:0:7657:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a102aa4000 3 00010000:00080000:1.0:1787862188.263339:0:7657:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a005471800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1787862188.266358:0:7657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787862188.266748:0:7657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787862188.266805:0:7657:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787862188.266822:0:7657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x391a6cd368cd9a55 00000100:00080000:0.0:1787862188.266837:0:7657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787862188.266844:0:7657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a005471800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1787862188.266889:0:7657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13c4c9680 x1874709246395520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787862188.266928:0:7657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787862188.267224:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862188.267245:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246395648:0@lo:400: 00000100:00100000:1.0:1787862188.267342:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.267392:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246395776:0@lo:400: 00000100:00100000:1.0:1787862188.267421:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.267441:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862188.267447:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246395904:0@lo:400: 00000100:00100000:1.0:1787862188.267473:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.267524:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395648 00000100:00100000:1.0:1787862188.267533:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395648 00000100:00100000:1.0:1787862188.267575:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395776 00000100:00100000:1.0:1787862188.267578:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395776 00000100:00100000:1.0:1787862188.267604:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862188.267613:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120582d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246395648:12345-0@lo:400: 00000100:00100000:1.0:1787862188.267679:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120582d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246395648:12345-0@lo:400: Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.267686:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862188.267720:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787862188.267727:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120582580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246395776:12345-0@lo:400: 00000100:00100000:1.0:1787862188.267761:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120582580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246395776:12345-0@lo:400: Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862188.267768:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787862188.267787:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787862188.267821:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120580000 x1874709246395776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862188.267838:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246395776:0@lo:400: 00010000:00080000:1.0:1787862188.267869:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120582940 x1874709246395648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862188.267879:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246395648:0@lo:400: 00000100:00100000:0.0:1787862188.268235:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395904 00000100:00100000:0.0:1787862188.268241:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395904 00000100:00100000:0.0:1787862188.268286:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862188.268293:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246395904:12345-0@lo:400: 00000100:00100000:0.0:1787862188.268341:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246395904:12345-0@lo:400: Request processed in 49us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.268348:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787862188.268371:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862188.268391:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a1205812c0 x1874709246395904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862188.268402:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246395904:0@lo:400: 00000100:00100000:2.0:1787862188.268522:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246395520:0@lo:38: 00000100:00100000:2.0:1787862188.268568:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862188.268693:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246395520 00000100:00100000:0.0:1787862188.268698:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246395520 00000100:00100000:0.0:1787862188.268737:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862188.268742:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3326:x1874709246395520:12345-0@lo:38: 00010000:00080000:0.0:1787862188.268772:0:5868:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1787862188.268818:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x391a6cd368cd9a5c 00000004:00100000:0.0:1787862188.268838:0:5868:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787862188.268880:0:5868:0:(import.c:65:import_set_state_nolock()) ffff89a0054e4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862188.268927:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874709246395520:12345-0@lo:38: Request processed in 184us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.268934:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787862188.269090:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13c4c9680 x1874709246395520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862188.269099:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862188.269107:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787862188.269117:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787862188.269123:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787862188.269126:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a005471800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787862188.269132:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246395520:0@lo:38: 00000040:00080000:0.0:1787862188.270661:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787862188.270919:0:7658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1874709246396032:0@lo:901: 00000100:00100000:1.0:1787862188.271013:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862188.271081:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aebf00 going to sleep for 11 seconds 00000020:01000000:2.0:1787862188.271143:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787862188.271191:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862188.271219:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.271233:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787862188.271293:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787862188.271296:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787862188.271298:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862188.271300:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862188.271301:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862188.271302:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862188.271304:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862188.271307:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862188.271308:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862188.271310:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862188.271312:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787862188.271318:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787862188.271321:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862188.271322:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787862188.271324:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862188.271325:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862188.271325:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862188.271327:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862188.271328:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862188.271329:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862188.271330:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862188.271331:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862188.271332:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787862188.271369:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787862188.271379:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246396160:0@lo:253: 00000100:00100000:2.0:1787862188.271423:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.271458:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862188.271579:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396032 00000100:00100000:0.0:1787862188.271587:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396032 00000100:00100000:0.0:1787862188.271658:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862188.271669:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1874709246396032:12345-0@lo:901: 00000100:00100000:0.0:1787862188.272217:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1874709246396032:12345-0@lo:901: Request processed in 548us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.272228:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862188.272264:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396160 00000100:00100000:0.0:1787862188.272276:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396160 00000100:00100000:0.0:1787862188.272305:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862188.272311:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:7644:x1874709246396160:12345-0@lo:253: 20000000:01000000:0.0:1787862188.272340:0:5860:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787862188.272359:0:5860:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1787862188.272410:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787862188.273147:0:7658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a120582940 x1874709246396032/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787862204 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862188.273167:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1874709246396032:0@lo:901: 20000000:01000000:0.0:1787862188.311545:0:5860:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787862188.311609:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787862188.316489:0:5884:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787862188.316505:0:5884:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787862188.316554:0:5884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.316580:0:5884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.316591:0:5884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.316656:0:5884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.316672:0:5884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 14 pid: 5862 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862188.316690:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5884:1874709246396288:0@lo:104: 00000100:00100000:2.0:1787862188.316785:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.316832:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862188.316998:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396288 00000100:00100000:2.0:1787862188.317007:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396288 00000100:00100000:2.0:1787862188.317082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862188.317093:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5884:x1874709246396288:12345-0@lo:104: 00010000:00010000:2.0:1787862188.317110:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317167:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862188.317174:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:5884:x1874709246396288:12345-0@lo:104: Request processed in 83us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862188.317181:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787862188.317208:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862188.317222:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317230:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b210400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862188.317234:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317242:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862188.317249:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862188.317255:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862188.317306:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317314:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862188.317334:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317341:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd99ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd99b4 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317360:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862188.317362:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862188.317363:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862188.317383:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246396416:0@lo:103: 00000100:00100000:2.0:1787862188.317418:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862188.317458:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396416 00000100:00100000:2.0:1787862188.317462:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396416 00010000:00010000:2.0:1787862188.317488:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 15 pid: 5862 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862188.317511:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862188.317518:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:3327:x1874709246396416:12345-0@lo:103: 00010000:00010000:2.0:1787862188.317530:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862188.317535:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 15 pid: 5862 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317545:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 15 pid: 5862 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317563:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317572:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787862188.317585:0:5855:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005338756s 00010000:00010000:2.0:1787862188.317589:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317596:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317603:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317610:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317615:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b211e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862188.317624:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317632:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317641:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317651:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862188.317682:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:3327:x1874709246396416:12345-0@lo:103: Request processed in 164us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862188.317689:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862188.317782:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246396416:0@lo:103: 00010000:00010000:2.0:1787862188.317830:0:5884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd99b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd99ad expref: 14 pid: 5862 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862188.317840:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5884:1874709246396288:0@lo:104: 00010000:00010000:2.0:1787862188.317851:0:5884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317859:0:5884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317864:0:5884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862188.317870:0:5884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9a63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862188.320972:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:7644:x1874709246396160:12345-0@lo:253: Request processed in 48635us (49523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862188.320995:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787862188.321010:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:7644:1874709246396160:0@lo:253: 10000000:01000000:2.0:1787862188.321356:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787862188.321360:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787862188.321362:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787862188.321363:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862188.321364:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862188.321365:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862188.321366:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862188.321368:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862188.321369:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862188.321370:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862188.321371:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862188.321372:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787862188.321387:0:7644:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787862188.326671:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862188.326904:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862188.327173:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862188.327381:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862188.327680:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862188.327863:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787862188.336412:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787862188.572325:0:7644:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787862188.572335:0:7644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787862188.572378:0:7644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787862188.572454:0:7644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787862188.572470:0:7644:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787862188.572512:0:7644:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787862189.188235:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862190.216956:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862191.112895:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246396544:0@lo:13: 00000100:00100000:2.0:1787862191.113010:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862191.113302:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396544 00000100:00100000:1.0:1787862191.113317:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396544 00000100:00100000:1.0:1787862191.113396:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862191.113405:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246396544:12345-0@lo:13: 00002000:00000024:1.0:1787862191.113449:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862191.113501:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246396544:12345-0@lo:13: Request processed in 97us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862191.113525:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787862191.113735:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a120582940 x1874709246396544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862191.113779:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246396544:0@lo:13: 00000100:00080000:0.0:1787862191.113970:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862191.236744:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862192.261268:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862193.284264:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862193.668359:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246396800:0@lo:400: 00000100:00100000:1.0:1787862193.668465:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862193.668536:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862193.668543:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120581a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246396672:0@lo:400: 00000100:00100000:1.0:1787862193.668579:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862193.668604:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246397184:0@lo:400: 00000100:00100000:1.0:1787862193.668628:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862193.668657:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246396928:0@lo:400: 00000100:00100000:1.0:1787862193.668682:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862193.668697:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862193.668702:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246397056:0@lo:400: 00000100:00100000:1.0:1787862193.668726:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862193.668940:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396800 00000100:00100000:1.0:1787862193.668948:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396800 00000100:00100000:1.0:1787862193.668992:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397184 00000100:00100000:1.0:1787862193.668995:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397184 00000100:00100000:1.0:1787862193.669019:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396928 00000100:00100000:1.0:1787862193.669022:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396928 00000100:00100000:1.0:1787862193.669062:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787862193.669071:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246396800:12345-0@lo:400: 00000100:00100000:1.0:1787862193.669131:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246396800:12345-0@lo:400: Request processed in 61us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862193.669139:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787862193.669157:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787862193.669164:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246397184:12345-0@lo:400: 00000100:00100000:1.0:1787862193.669203:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246397184:12345-0@lo:400: Request processed in 41us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862193.669209:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787862193.669220:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862193.669226:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246396928:12345-0@lo:400: 00000100:00100000:1.0:1787862193.669255:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246396928:12345-0@lo:400: Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862193.669260:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862193.669280:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246396672 00000100:00100000:1.0:1787862193.669284:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246396672 00000100:00100000:1.0:1787862193.669309:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787862193.669315:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3330:x1874709246396672:12345-0@lo:400: 00000100:00100000:1.0:1787862193.669344:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:3330:x1874709246396672:12345-0@lo:400: Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862193.669349:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787862193.669383:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397056 00000100:00100000:1.0:1787862193.669387:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397056 00000100:00100000:1.0:1787862193.669417:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862193.669424:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246397056:12345-0@lo:400: 00000100:00100000:1.0:1787862193.669453:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246397056:12345-0@lo:400: Request processed in 30us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862193.669459:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787862193.669474:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862193.669479:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787862193.669516:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a120582940 x1874709246397056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862193.669531:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120582940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246397056:0@lo:400: 00010000:00080000:1.0:1787862193.669553:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a120580b40 x1874709246396928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862193.669562:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246396928:0@lo:400: 00000100:00100000:1.0:1787862193.669758:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120581a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246396672:0@lo:400: 00010000:00080000:1.0:1787862193.669770:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a008388000 x1874709246397184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862193.669779:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246397184:0@lo:400: 00010000:00080000:1.0:1787862193.669788:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1205812c0 x1874709246396800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862193.669796:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246396800:0@lo:400: 00010000:00010000:2.0:1787862194.309987:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862195.098937:0:8000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787862195.332221:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862196.228283:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246397312:0@lo:13: 00000100:00100000:0.0:1787862196.228380:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862196.230067:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397312 00000100:00100000:0.0:1787862196.230084:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397312 00000100:00100000:0.0:1787862196.232713:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862196.232733:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246397312:12345-0@lo:13: 00002000:00000024:0.0:1787862196.232781:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862196.232899:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246397312:12345-0@lo:13: Request processed in 171us (4519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862196.232906:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787862196.233418:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862196.233813:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1204bb0c0 x1874709246397312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862196.233846:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246397312:0@lo:13: 00010000:00010000:3.0:1787862196.357224:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862197.380932:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787862198.281679:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787862198.281691:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a1102e9000 from 30 10000000:01000000:1.0:1787862198.281697:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787862198.281756:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.281770:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.281784:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862198.281815:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246397440:0@lo:101: 00000100:00100000:1.0:1787862198.281919:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.282018:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.293255:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397440 00000100:00100000:0.0:1787862198.293275:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397440 00000100:00100000:0.0:1787862198.293362:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862198.293375:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246397440:12345-0@lo:101: 00010000:00010000:0.0:1787862198.293401:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862198.293424:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a6a expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.293460:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.293474:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.293484:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030200, rc 0) 00000100:00100000:0.0:1787862198.294291:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246397440:12345-0@lo:101: Request processed in 913us (12367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.294301:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862198.294381:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246397440:0@lo:101: 00010000:00010000:0.0:1787862198.294403:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.294416:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.295217:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246397568:0@lo:501: 00000100:00100000:0.0:1787862198.295282:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.295321:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.295342:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397568 00000100:00100000:0.0:1787862198.295349:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397568 00000100:00100000:0.0:1787862198.295386:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787862198.295407:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246397568:12345-0@lo:501: 00000100:00100000:0.0:1787862198.295993:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246397568:12345-0@lo:501: Request processed in 584us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.296003:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787862198.296088:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246397568:0@lo:501: 00000100:00100000:0.0:1787862198.297674:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246397696:0@lo:503: 00000100:00100000:0.0:1787862198.297765:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.297808:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.297981:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397696 00000100:00100000:0.0:1787862198.297989:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397696 00000100:00100000:0.0:1787862198.298057:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787862198.298068:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246397696:12345-0@lo:503: 00000100:00100000:0.0:1787862198.301807:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246397696:12345-0@lo:503: Request processed in 3732us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.301826:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787862198.303890:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246397696:0@lo:503: 00000100:00100000:0.0:1787862198.317193:0:8116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8116:1874709246397824:0@lo:502: 00000100:00100000:0.0:1787862198.317325:0:8116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.317377:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397824 00000100:00100000:0.0:1787862198.317385:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397824 00000100:00100000:0.0:1787862198.317447:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787862198.317456:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8116:x1874709246397824:12345-0@lo:502: 00000100:00100000:0.0:1787862198.317826:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8116:x1874709246397824:12345-0@lo:502: Request processed in 370us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.317833:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787862198.317907:0:8116:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.317937:0:8116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8116:1874709246397824:0@lo:502: 00000100:00100000:0.0:1787862198.318002:0:8116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8116:1874709246397952:0@lo:502: 00000100:00100000:0.0:1787862198.318035:0:8116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.318078:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246397952 00000100:00100000:0.0:1787862198.318081:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246397952 00000100:00100000:0.0:1787862198.318106:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787862198.318113:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8116:x1874709246397952:12345-0@lo:502: 00000100:00100000:0.0:1787862198.318314:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8116:x1874709246397952:12345-0@lo:502: Request processed in 201us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.318322:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787862198.318355:0:8116:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.318369:0:8116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8116:1874709246397952:0@lo:502: 00000040:00080000:0.0:1787862198.318387:0:8116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787862198.318458:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787862198.318476:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862198.318490:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.318504:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862198.318515:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787862198.318518:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787862198.318521:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862198.318549:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.318557:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.318577:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.318589:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398080:0@lo:101: 00000100:00100000:0.0:1787862198.318619:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.318640:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.318670:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398080 00000100:00100000:1.0:1787862198.318677:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398080 00000100:00100000:1.0:1787862198.318709:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787862198.318718:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246398080:12345-0@lo:101: 00010000:00010000:1.0:1787862198.318729:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862198.318746:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a78 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.318774:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.318788:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.318798:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9c00, rc 0) 00000100:00100000:1.0:1787862198.318842:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246398080:12345-0@lo:101: Request processed in 126us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.318849:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787862198.320747:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398080:0@lo:101: 00010000:00010000:0.0:1787862198.320791:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.320807:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.320913:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398208:0@lo:501: 00000100:00100000:0.0:1787862198.320985:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.321023:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.321192:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398208 00000100:00100000:0.0:1787862198.321199:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398208 00000100:00100000:0.0:1787862198.321325:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862198.321336:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246398208:12345-0@lo:501: 00000100:00100000:0.0:1787862198.321757:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246398208:12345-0@lo:501: Request processed in 421us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.321766:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862198.321813:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398208:0@lo:501: 00000100:00100000:0.0:1787862198.321844:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398336:0@lo:503: 00000100:00100000:0.0:1787862198.321903:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.321938:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.321953:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398336 00000100:00100000:1.0:1787862198.321961:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398336 00000100:00100000:1.0:1787862198.321997:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787862198.322006:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246398336:12345-0@lo:503: 00000100:00100000:1.0:1787862198.322218:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246398336:12345-0@lo:503: Request processed in 213us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.322223:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787862198.322307:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398336:0@lo:503: 00000100:00100000:1.0:1787862198.325676:0:8117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8117:1874709246398464:0@lo:502: 00000100:00100000:1.0:1787862198.325800:0:8117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.325866:0:8117:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.326215:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398464 00000100:00100000:0.0:1787862198.326224:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398464 00000100:00100000:0.0:1787862198.326274:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787862198.326296:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8117:x1874709246398464:12345-0@lo:502: 00000100:00100000:0.0:1787862198.326633:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8117:x1874709246398464:12345-0@lo:502: Request processed in 338us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.326642:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787862198.327019:0:8117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8117:1874709246398464:0@lo:502: 00000020:01000000:1.0:1787862198.328656:0:8117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862198.328675:0:8117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862198.328678:0:8117:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862198.328687:0:8117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862198.328689:0:8117:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787862198.328736:0:8117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8117:1874709246398592:0@lo:502: 00000100:00100000:1.0:1787862198.328826:0:8117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.328886:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398592 00000100:00100000:1.0:1787862198.328894:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398592 00000100:00100000:1.0:1787862198.328956:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787862198.328966:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8117:x1874709246398592:12345-0@lo:502: 00000100:00100000:1.0:1787862198.329246:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8117:x1874709246398592:12345-0@lo:502: Request processed in 281us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.329259:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787862198.329324:0:8117:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.329349:0:8117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8117:1874709246398592:0@lo:502: 00000020:01000000:1.0:1787862198.329380:0:8117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862198.329387:0:8117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862198.329388:0:8117:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787862198.329394:0:8117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787862198.329661:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787862198.329687:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787862198.329700:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.329712:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862198.329724:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787862198.329727:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a102b43800 from 30 10000000:01000000:0.0:1787862198.329730:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787862198.329762:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.329770:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.329780:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.329810:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398720:0@lo:101: 00000100:00100000:0.0:1787862198.329852:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.329888:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.329905:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398720 00000100:00100000:0.0:1787862198.329910:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398720 00000100:00100000:0.0:1787862198.329940:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862198.329948:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246398720:12345-0@lo:101: 00010000:00010000:0.0:1787862198.329959:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862198.329973:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a86 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.329998:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.330010:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.330020:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030c00, rc 0) 00000100:00100000:0.0:1787862198.330085:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246398720:12345-0@lo:101: Request processed in 135us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.330093:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862198.330164:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398720:0@lo:101: 00010000:00010000:0.0:1787862198.330183:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.330192:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.330251:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398848:0@lo:501: 00000100:00100000:0.0:1787862198.330276:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.330298:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.330311:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398848 00000100:00100000:0.0:1787862198.330314:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398848 00000100:00100000:0.0:1787862198.330333:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787862198.330339:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246398848:12345-0@lo:501: 00000100:00100000:0.0:1787862198.330599:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246398848:12345-0@lo:501: Request processed in 259us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.330607:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787862198.330637:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398848:0@lo:501: 00000100:00100000:0.0:1787862198.330663:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398976:0@lo:503: 00000100:00100000:0.0:1787862198.330698:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.330715:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108901780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.330731:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246398976 00000100:00100000:0.0:1787862198.330735:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246398976 00000100:00100000:0.0:1787862198.330760:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862198.330767:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246398976:12345-0@lo:503: 00000100:00100000:0.0:1787862198.330954:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246398976:12345-0@lo:503: Request processed in 186us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.330961:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787862198.331120:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246398976:0@lo:503: 00000100:00100000:0.0:1787862198.334762:0:8119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8119:1874709246399104:0@lo:502: 00000100:00100000:0.0:1787862198.334905:0:8119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.335016:0:8119:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107e57780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.335148:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399104 00000100:00100000:1.0:1787862198.335158:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399104 00000100:00100000:1.0:1787862198.335253:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787862198.335263:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8119:x1874709246399104:12345-0@lo:502: 00000100:00100000:1.0:1787862198.335620:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8119:x1874709246399104:12345-0@lo:502: Request processed in 357us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.335629:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787862198.335942:0:8119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8119:1874709246399104:0@lo:502: 00000100:00100000:0.0:1787862198.336008:0:8119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8119:1874709246399232:0@lo:502: 00000100:00100000:0.0:1787862198.336071:0:8119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.336099:0:8119:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.336180:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399232 00000100:00100000:1.0:1787862198.336186:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399232 00000100:00100000:1.0:1787862198.336248:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787862198.336256:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8119:x1874709246399232:12345-0@lo:502: 00000100:00100000:1.0:1787862198.336417:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8119:x1874709246399232:12345-0@lo:502: Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.336424:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787862198.336580:0:8119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8119:1874709246399232:0@lo:502: 00000040:00080000:0.0:1787862198.336600:0:8119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787862198.341888:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787862198.341941:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862198.341957:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862198.341971:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862198.341984:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787862198.341988:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a102b43800 from 5 10000000:01000000:3.0:1787862198.341992:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787862198.342077:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862198.342087:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862198.342099:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862198.342128:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399360:0@lo:101: 00000100:00100000:3.0:1787862198.342238:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862198.342295:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c87900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.342321:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399360 00000100:00100000:0.0:1787862198.342330:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399360 00000100:00100000:0.0:1787862198.342389:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787862198.342399:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246399360:12345-0@lo:101: 00010000:00010000:0.0:1787862198.342414:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862198.342430:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030600/0x391a6cd368cd9a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9a94 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342458:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030600/0x391a6cd368cd9a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9a94 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342468:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030600/0x391a6cd368cd9a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a94 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342476:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030600, rc 0) 00000100:00100000:0.0:1787862198.342531:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246399360:12345-0@lo:101: Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.342536:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787862198.342580:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399360:0@lo:101: 00010000:00010000:0.0:1787862198.342591:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342608:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.342666:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399488:0@lo:256: 00000100:00100000:0.0:1787862198.342691:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.342703:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.342713:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399488 00000100:00100000:0.0:1787862198.342716:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399488 00000100:00100000:0.0:1787862198.342731:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787862198.342735:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246399488:12345-0@lo:256: 20000000:01000000:0.0:1787862198.342747:0:5862:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787862198.342764:0:5862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787862198.342766:0:5862:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787862198.342822:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246399488:12345-0@lo:256: Request processed in 87us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.342828:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787862198.342849:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399488:0@lo:256: 10000000:01000000:0.0:1787862198.342914:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787862198.342921:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342929:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862198.342936:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787862198.342939:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787862198.342941:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862198.342964:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342971:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.342979:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.342991:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399616:0@lo:101: 00000100:00100000:0.0:1787862198.343023:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.343072:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.343136:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399616 00000100:00100000:1.0:1787862198.343141:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399616 00000100:00100000:1.0:1787862198.343175:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787862198.343182:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246399616:12345-0@lo:101: 00010000:00010000:1.0:1787862198.343190:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862198.343203:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9aa2 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.343221:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.343230:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862198.343237:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8800, rc 0) 00000100:00100000:1.0:1787862198.343271:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246399616:12345-0@lo:101: Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.343277:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787862198.343277:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399616:0@lo:101: 00010000:00010000:0.0:1787862198.343288:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862198.343296:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862198.343343:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399744:0@lo:501: 00000100:00100000:0.0:1787862198.343369:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.343428:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.343465:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399744 00000100:00100000:1.0:1787862198.343470:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399744 00000100:00100000:1.0:1787862198.343590:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787862198.343598:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246399744:12345-0@lo:501: 00000100:00100000:1.0:1787862198.343973:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246399744:12345-0@lo:501: Request processed in 374us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.343981:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862198.344098:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399744:0@lo:501: 00000100:00100000:2.0:1787862198.344135:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399872:0@lo:503: 00000100:00100000:2.0:1787862198.344180:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.344440:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.344633:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246399872 00000100:00100000:0.0:1787862198.344639:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246399872 00000100:00100000:0.0:1787862198.344724:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787862198.344732:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246399872:12345-0@lo:503: 00000100:00100000:0.0:1787862198.345071:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246399872:12345-0@lo:503: Request processed in 339us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.345079:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787862198.345267:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246399872:0@lo:503: 00000100:00100000:1.0:1787862198.345775:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8120:1874709246400000:0@lo:502: 00000100:00100000:1.0:1787862198.345836:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.345909:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862198.345952:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400000 00000100:00100000:0.0:1787862198.345958:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400000 00000100:00100000:0.0:1787862198.346031:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787862198.346118:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8120:x1874709246400000:12345-0@lo:502: 00000100:00100000:0.0:1787862198.346446:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8120:x1874709246400000:12345-0@lo:502: Request processed in 406us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.346454:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862198.346744:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8120:1874709246400000:0@lo:502: 00000020:01000000:2.0:1787862198.346779:0:8120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787862198.346789:0:8120:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787862198.346799:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862198.346801:0:8120:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787862198.346807:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787862198.346812:0:8120:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:2.0:1787862198.346840:0:8120:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787862198.346844:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862198.346871:0:8120:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a111028000) 00000020:00000080:2.0:1787862198.346900:0:8120:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787862198.346907:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787862198.347000:0:8120:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787862198.347008:0:8120:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787862198.347016:0:8120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cd9ab7 00010000:00080000:2.0:1787862198.347093:0:8120:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a141983000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:2.0:1787862198.347372:0:8120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787862198.347981:0:8120:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787862198.347999:0:8120:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787862198.348825:0:8120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862198.349182:0:8120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862198.349247:0:8120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787862198.349311:0:8120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787862198.349948:0:8121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862198.349955:0:8121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787862198.352771:0:8120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862198.352793:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787862198.352835:0:8120:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787862198.352909:0:8120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cd9abe 00000100:00080000:2.0:1787862198.352925:0:8120:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862198.352933:0:8120:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a141983000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1787862198.352983:0:8120:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13c42f480 x1874709246400128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862198.353071:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246400128:0@lo:8: 00000100:00100000:0.0:1787862198.353169:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787862198.353330:0:8120:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787862198.353419:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400128 00000100:00100000:0.0:1787862198.353428:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400128 00000100:00100000:0.0:1787862198.353469:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862198.353477:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3326:x1874709246400128:12345-0@lo:8: 00010000:00080000:0.0:1787862198.353516:0:6712:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:0.0:1787862198.353550:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cd9ac5 00002000:00100000:0.0:1787862198.353570:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a0054e3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113978 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787862198.353576:0:6712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787862198.353581:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787862198.353810:0:6712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787862198.354037:0:6712:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787862198.354105:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a0054e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862198.354181:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3326:x1874709246400128:12345-0@lo:8: Request processed in 702us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.354190:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787862198.354352:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42f480 x1874709246400128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862198.354364:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862198.354382:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787862198.354391:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787862198.354397:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787862198.354399:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a141983000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787862198.354741:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246400512:0@lo:400: 00000100:00100000:2.0:1787862198.354788:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.354820:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862198.354827:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246400640:0@lo:400: 00000100:00100000:2.0:1787862198.354870:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.355068:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246400256:0@lo:400: 00000100:00100000:1.0:1787862198.355105:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.355130:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862198.355136:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246400384:0@lo:400: 00000100:00100000:1.0:1787862198.355163:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862198.355199:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400512 00000100:00100000:1.0:1787862198.355206:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400512 00000100:00100000:1.0:1787862198.355264:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862198.355275:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246400512:12345-0@lo:400: 00000100:00100000:1.0:1787862198.355329:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246400512:12345-0@lo:400: Request processed in 57us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.355337:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862198.355361:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400640 00000100:00100000:1.0:1787862198.355364:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400640 00000100:00100000:1.0:1787862198.355386:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400256 00000100:00100000:1.0:1787862198.355389:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400256 00000100:00100000:1.0:1787862198.355401:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400384 00000100:00100000:1.0:1787862198.355403:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400384 00000100:00100000:1.0:1787862198.355416:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862198.355422:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246400640:12345-0@lo:400: 00000100:00100000:1.0:1787862198.355461:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246400640:12345-0@lo:400: Request processed in 39us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.355467:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862198.355479:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862198.355485:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246400256:12345-0@lo:400: 00000100:00100000:1.0:1787862198.355528:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246400256:12345-0@lo:400: Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.355535:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862198.355546:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862198.355552:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246400384:12345-0@lo:400: 00000100:00100000:1.0:1787862198.355577:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246400384:12345-0@lo:400: Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862198.355583:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787862198.355603:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862198.355607:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787862198.355630:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42c3c0 x1874709246400640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862198.355766:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246400640:0@lo:400: 00010000:00080000:1.0:1787862198.355784:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42fc00 x1874709246400512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862198.355794:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246400512:0@lo:400: 00010000:00080000:1.0:1787862198.355825:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42e1c0 x1874709246400384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862198.355835:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246400384:0@lo:400: 00010000:00080000:1.0:1787862198.355869:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42f0c0 x1874709246400256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862198.355878:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246400256:0@lo:400: 00000004:00080000:0.0:1787862198.356209:0:3326:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787862198.356220:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246400128:0@lo:8: 00000004:00080000:1.0:1787862198.356286:0:8121:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787862198.356494:0:8121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 249391452761ns, next at 0ns, rc = 0 00000020:01000000:2.0:1787862198.361455:0:8120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862198.361471:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862198.361474:0:8120:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787862198.361479:0:8120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862198.361484:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862198.361486:0:8120:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787862198.361489:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787862198.361491:0:8120:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787862198.361558:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8120:1874709246400768:0@lo:502: 00000100:00100000:2.0:1787862198.361687:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.361744:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400768 00000100:00100000:2.0:1787862198.361752:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400768 00000100:00100000:2.0:1787862198.361800:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787862198.361819:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8120:x1874709246400768:12345-0@lo:502: 00000100:00100000:2.0:1787862198.362161:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8120:x1874709246400768:12345-0@lo:502: Request processed in 343us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862198.362170:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787862198.362239:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862198.362265:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8120:1874709246400768:0@lo:502: 00000020:01000000:2.0:1787862198.362296:0:8120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862198.362302:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862198.362304:0:8120:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787862198.362308:0:8120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787862198.362383:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787862198.362406:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787862198.362418:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362432:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862198.362445:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787862198.362448:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89a108763490 from 1 10000000:01000000:2.0:1787862198.362451:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787862198.362482:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362491:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362502:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862198.362528:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246400896:0@lo:101: 00000100:00100000:2.0:1787862198.362560:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.362583:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862198.362599:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246400896 00000100:00100000:2.0:1787862198.362603:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246400896 00000100:00100000:2.0:1787862198.362627:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787862198.362635:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246400896:12345-0@lo:101: 00010000:00010000:2.0:1787862198.362644:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862198.362661:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9acc expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362685:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362699:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362710:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b211e00, rc 0) 00000100:00100000:2.0:1787862198.362740:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246400896:12345-0@lo:101: Request processed in 106us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862198.362747:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787862198.362780:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246400896:0@lo:101: 00010000:00010000:2.0:1787862198.362795:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.362804:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862198.362880:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246401024:0@lo:501: 00000100:00100000:2.0:1787862198.362906:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.362921:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862198.362934:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401024 00000100:00100000:2.0:1787862198.362938:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401024 00000100:00100000:2.0:1787862198.362960:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787862198.362967:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246401024:12345-0@lo:501: 00000100:00100000:2.0:1787862198.363263:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246401024:12345-0@lo:501: Request processed in 294us (354us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862198.363271:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787862198.363306:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246401024:0@lo:501: 10000000:01000000:2.0:1787862198.363334:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787862198.363340:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.363348:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862198.405936:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787862198.427443:0:8122:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787862198.427485:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401280:0@lo:7: 00000100:00100000:2.0:1787862198.427593:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.427626:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.427834:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246401152:0@lo:13: 00000100:00100000:1.0:1787862198.427882:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862198.431310:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401280 00000100:00100000:0.0:1787862198.431329:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401280 00000100:00100000:0.0:1787862198.431404:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862198.431416:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8122:x1874709246401280:12345-0@lo:7: 00000100:00100000:2.0:1787862198.436320:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401152 00000100:00100000:2.0:1787862198.436340:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401152 00000100:00100000:2.0:1787862198.436430:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787862198.436459:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246401152:12345-0@lo:13: 00002000:00000024:2.0:1787862198.436515:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787862198.436627:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246401152:12345-0@lo:13: Request processed in 171us (8744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862198.436636:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787862198.436705:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42cb40 x1874709246401152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862198.436729:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246401152:0@lo:13: 00000100:00080000:2.0:1787862198.438174:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787862198.444452:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787862198.444463:0:6709:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787862198.444597:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8122:x1874709246401280:12345-0@lo:7: Request processed in 13177us (16998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.444611:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787862198.444837:0:8122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42d2c0 x1874709246401280/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787862214 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862198.444866:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401280:0@lo:7: 00000004:00080000:2.0:1787862198.444886:0:8122:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787862198.444935:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401408:0@lo:5: 00000100:00100000:2.0:1787862198.444974:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.445021:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862198.445067:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401408 00000100:00100000:2.0:1787862198.445074:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401408 00000100:00100000:2.0:1787862198.445118:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787862198.445126:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8122:x1874709246401408:12345-0@lo:5: 00002000:00080000:2.0:1787862198.445157:0:6712:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787862198.445161:0:6712:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787862198.445404:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8122:x1874709246401408:12345-0@lo:5: Request processed in 277us (428us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787862198.445411:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787862198.445439:0:8122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42d2c0 x1874709246401408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862214 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862198.445468:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401408:0@lo:5: 00000004:00080000:2.0:1787862198.445477:0:8122:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787862198.445502:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401536:0@lo:700: 00000100:00100000:2.0:1787862198.445524:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.445541:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862198.445553:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401536 00000100:00100000:2.0:1787862198.445557:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401536 00000100:00100000:2.0:1787862198.445579:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862198.445585:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8122:x1874709246401536:12345-0@lo:700: 00000100:00100000:2.0:1787862198.445614:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6718:1874709246401664:0@lo:700: 00000100:00100000:2.0:1787862198.445641:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.445671:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862198.445706:0:5875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401664 00000100:00100000:2.0:1787862198.445709:0:5875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401664 00000100:00100000:2.0:1787862198.445737:0:5875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862198.445742:0:5875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6718:x1874709246401664:12345-0@lo:700: 00000004:00080000:1.0:1787862198.502008:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787862198.550833:0:5875:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787862198.563438:0:5875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6718:x1874709246401664:12345-0@lo:700: Request processed in 117682us (117782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.563460:0:5875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787862198.563724:0:6718:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42cf00 x1874709246401664/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787862214 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862198.563747:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6718:1874709246401664:0@lo:700: 40000000:02000000:1.0:1787862198.563765:0:6718:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1787862198.675115:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8122:x1874709246401536:12345-0@lo:700: Request processed in 229511us (229570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862198.675137:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1787862198.675203:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787862198.675220:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1787862198.675453:0:8122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42c000 x1874709246401536/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787862214 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862198.675473:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401536:0@lo:700: 00000004:02000040:2.0:1787862198.773535:0:8122:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787862198.779209:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401792:0@lo:5: 00000100:00100000:2.0:1787862198.779324:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862198.779393:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862198.780940:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401792 00000100:00100000:1.0:1787862198.780954:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401792 00000100:00100000:1.0:1787862198.781026:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862198.781036:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8122:x1874709246401792:12345-0@lo:5: 00002000:00080000:1.0:1787862198.792306:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787862198.792335:0:6709:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787862198.801917:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8122:x1874709246401792:12345-0@lo:5: Request processed in 20867us (22577us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787862198.801934:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787862198.805423:0:8122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42c000 x1874709246401792/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862214 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862198.805447:0:8122:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787862198.805477:0:8122:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89a13c42c000 x1874709246401792/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862214 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862198.805490:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8122:1874709246401792:0@lo:5: 00000004:00080000:3.0:1787862198.805569:0:8122:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787862199.428692:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862200.454143:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787862200.656278:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787862201.236919:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862201.236977:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223309440 00000100:00100000:0.0:1787862201.236992:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223309440 00000100:00100000:0.0:1787862201.237061:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:0.0:1787862201.237072:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1874709223309440:12345-192.168.202.9@tcp:250: 00010000:00080000:0.0:1787862201.237127:0:5863:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7@192.168.202.9@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1787862201.237170:0:5863:0:(genops.c:1385:class_connect()) connect: client 4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7, cookie 0x391a6cd368cd9ada 00000100:00080000:0.0:1787862201.237631:0:5863:0:(import.c:65:import_set_state_nolock()) ffff89a0054e3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862201.237744:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+5:2351:x1874709223309440:12345-192.168.202.9@tcp:250: Request processed in 671us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862201.237754:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:3.0:1787862201.243986:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862201.248648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223309568 00000100:00100000:0.0:1787862201.248679:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223309568 00000100:00100000:0.0:1787862201.249005:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:0.0:1787862201.249018:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+5:5584:x1874709223309568:12345-192.168.202.9@tcp:101: 00010000:00010000:0.0:1787862201.249065:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862201.249088:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c046e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862201.249141:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862201.249155:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862201.249167:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030400, rc 0) 00000100:00100000:0.0:1787862201.249259:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+6:5584:x1874709223309568:12345-192.168.202.9@tcp:101: Request processed in 244us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862201.249267:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:0.0:1787862201.254426:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862201.254593:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223309696 00000100:00100000:1.0:1787862201.254608:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223309696 00000100:00100000:1.0:1787862201.254694:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:1.0:1787862201.254707:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+6:5584:x1874709223309696:12345-192.168.202.9@tcp:501: 00000100:00100000:1.0:1787862201.255187:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+6:5584:x1874709223309696:12345-192.168.202.9@tcp:501: Request processed in 481us (776us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787862201.255196:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:1.0:1787862201.272919:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862201.273707:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223309824 00000100:00100000:2.0:1787862201.273724:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223309824 00000100:00100000:2.0:1787862201.273803:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:2.0:1787862201.273817:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+6:5584:x1874709223309824:12345-192.168.202.9@tcp:101: 00010000:00010000:2.0:1787862201.273851:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862201.273880:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0475 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862201.273921:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862201.273935:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862201.273946:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b210c00, rc 0) 00000100:00100000:2.0:1787862201.274612:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+7:5584:x1874709223309824:12345-192.168.202.9@tcp:101: Request processed in 795us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862201.274632:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:3.0:1787862201.278419:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862201.278615:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223309952 00000100:00100000:0.0:1787862201.278637:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223309952 00000100:00100000:0.0:1787862201.278738:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:0.0:1787862201.278750:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+7:5584:x1874709223309952:12345-192.168.202.9@tcp:501: 00000100:00100000:0.0:1787862201.279183:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5584:x1874709223309952:12345-192.168.202.9@tcp:501: Request processed in 434us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862201.279193:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:1.0:1787862201.282331:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862201.282469:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310080 00000100:00100000:3.0:1787862201.282492:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310080 00000100:00100000:3.0:1787862201.282561:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:3.0:1787862201.282572:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5584:x1874709223310080:12345-192.168.202.9@tcp:503: 00000100:00100000:3.0:1787862201.283321:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5584:x1874709223310080:12345-192.168.202.9@tcp:503: Request processed in 744us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862201.283334:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:1.0:1787862201.305680:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862201.305816:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310208 00000100:00100000:2.0:1787862201.305838:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310208 00000100:00100000:2.0:1787862201.305910:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:2.0:1787862201.305921:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5603:x1874709223310208:12345-192.168.202.9@tcp:502: 00000100:00100000:2.0:1787862201.306392:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5603:x1874709223310208:12345-192.168.202.9@tcp:502: Request processed in 472us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862201.306402:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:3.0:1787862201.333203:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862201.333346:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310336 00000100:00100000:0.0:1787862201.333358:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310336 00000100:00100000:0.0:1787862201.333440:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:0.0:1787862201.333453:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5603:x1874709223310336:12345-192.168.202.9@tcp:502: 00000100:00100000:0.0:1787862201.333974:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5603:x1874709223310336:12345-192.168.202.9@tcp:502: Request processed in 520us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862201.333983:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:2.0:1787862201.346871:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862201.346920:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310464 00000100:00100000:2.0:1787862201.346932:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310464 00000100:00100000:2.0:1787862201.347003:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:2.0:1787862201.347015:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5584:x1874709223310464:12345-192.168.202.9@tcp:101: 00010000:00010000:2.0:1787862201.347069:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862201.347095:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9aef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c049f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862201.347131:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c049f expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862201.347144:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c049f expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862201.347155:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b211600, rc 0) 00000100:00100000:2.0:1787862201.347241:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5584:x1874709223310464:12345-192.168.202.9@tcp:101: Request processed in 228us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862201.347249:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:2.0:1787862201.350821:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862201.351302:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310592 00000100:00100000:2.0:1787862201.351315:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310592 00000100:00100000:2.0:1787862201.351380:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:2.0:1787862201.351392:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5584:x1874709223310592:12345-192.168.202.9@tcp:256: 20000000:01000000:2.0:1787862201.351429:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787862201.351457:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787862201.351462:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787862201.351466:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787862201.351469:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787862201.353021:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246401920:0@lo:13: 00000100:00100000:0.0:1787862201.353134:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862201.353341:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246401920 00000100:00100000:3.0:1787862201.353351:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246401920 00000100:00100000:3.0:1787862201.353420:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862201.353431:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246401920:12345-0@lo:13: 00000100:00080000:0.0:1787862201.354258:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787862201.354767:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862201.355315:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246401920:12345-0@lo:13: Request processed in 1881us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862201.355329:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862201.355972:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5584:x1874709223310592:12345-192.168.202.9@tcp:256: Request processed in 4578us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862201.355997:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 121 00010000:00080000:0.0:1787862201.356369:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1204ba580 x1874709246401920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862201.356408:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246401920:0@lo:13: 00000100:00100000:2.0:1787862201.361552:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862201.361768:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310720 00000100:00100000:0.0:1787862201.361780:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310720 00000100:00100000:0.0:1787862201.361852:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:0.0:1787862201.361862:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5584:x1874709223310720:12345-192.168.202.9@tcp:101: 00010000:00010000:0.0:1787862201.361883:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862201.361904:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c04a6 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862201.361960:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862201.361971:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862201.361982:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030e00, rc 0) 00000100:00100000:0.0:1787862201.362082:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5584:x1874709223310720:12345-192.168.202.9@tcp:101: Request processed in 221us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862201.362089:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:3.0:1787862201.363946:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862201.364089:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310848 00000100:00100000:0.0:1787862201.364099:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310848 00000100:00100000:0.0:1787862201.364165:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:0.0:1787862201.364176:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5584:x1874709223310848:12345-192.168.202.9@tcp:501: 00000100:00100000:0.0:1787862201.364580:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5584:x1874709223310848:12345-192.168.202.9@tcp:501: Request processed in 405us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862201.364589:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:0.0:1787862201.376736:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862201.376844:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223310976 00000100:00100000:2.0:1787862201.376858:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223310976 00000100:00100000:2.0:1787862201.376929:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:2.0:1787862201.376941:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5584:x1874709223310976:12345-192.168.202.9@tcp:503: 00000100:00100000:2.0:1787862201.377786:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5584:x1874709223310976:12345-192.168.202.9@tcp:503: Request processed in 843us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862201.377799:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:2.0:1787862201.389294:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862201.389420:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311104 00000100:00100000:3.0:1787862201.389432:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311104 00000100:00100000:3.0:1787862201.389516:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:3.0:1787862201.389526:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5608:x1874709223311104:12345-192.168.202.9@tcp:502: 00000100:00100000:3.0:1787862201.390110:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5608:x1874709223311104:12345-192.168.202.9@tcp:502: Request processed in 582us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862201.390119:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:2.0:1787862201.394113:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862201.394200:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311232 00000100:00100000:3.0:1787862201.394214:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311232 00000100:00100000:3.0:1787862201.394282:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:3.0:1787862201.394295:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5608:x1874709223311232:12345-192.168.202.9@tcp:502: 00000100:00100000:3.0:1787862201.394765:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5608:x1874709223311232:12345-192.168.202.9@tcp:502: Request processed in 471us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862201.394775:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:2.0:1787862201.402663:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862201.403491:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311360 00000100:00100000:1.0:1787862201.403505:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311360 00000100:00100000:1.0:1787862201.403568:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:1.0:1787862201.403578:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874709223311360:12345-192.168.202.9@tcp:38: 00010000:00080000:1.0:1787862201.403733:0:5870:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1787862201.403805:0:5870:0:(genops.c:1385:class_connect()) connect: client c20d7abe-3b31-4da4-909a-c5bb95bfc247, cookie 0x391a6cd368cd9afd 00000004:00100000:1.0:1787862201.403855:0:5870:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787862201.403863:0:5870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787862201.448709:0:5870:0:(import.c:65:import_set_state_nolock()) ffff89a005474800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862201.448846:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2351:x1874709223311360:12345-192.168.202.9@tcp:38: Request processed in 45265us (46194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862201.448861:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00010000:00010000:3.0:1787862201.485356:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862202.455427:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862202.455627:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311616 00000100:00100000:1.0:1787862202.455640:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311616 00000100:00100000:1.0:1787862202.455736:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1787862202.455748:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5584:x1874709223311616:12345-192.168.202.9@tcp:41: 00000004:00000024:1.0:1787862202.455808:0:5869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787862202.455916:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5584:x1874709223311616:12345-192.168.202.9@tcp:41: Request processed in 170us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862202.455925:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00080000:0.0:1787862202.456220:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862202.456686:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862202.456767:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311488 00000100:00100000:1.0:1787862202.456775:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311488 00000100:00100000:1.0:1787862202.456832:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862202.456842:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:0:x1874709223311488:12345-192.168.202.9@tcp:41: 00000004:00000024:1.0:1787862202.456866:0:5870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787862202.456968:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:0:x1874709223311488:12345-192.168.202.9@tcp:41: Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862202.456976:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862202.461903:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862202.462083:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311744 00000100:00100000:2.0:1787862202.462097:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311744 00000100:00100000:2.0:1787862202.462221:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1787862202.462235:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a0083883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5584:x1874709223311744:12345-192.168.202.9@tcp:40: 00000100:00100000:2.0:1787862202.462377:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a0083883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5584:x1874709223311744:12345-192.168.202.9@tcp:40: Request processed in 145us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862202.462385:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1787862202.467287:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862202.467344:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862202.469605:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223311872 00000100:00100000:3.0:1787862202.469627:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223311872 00000100:00100000:3.0:1787862202.469688:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312000 00000100:00100000:3.0:1787862202.469692:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312000 00000100:00100000:3.0:1787862202.469717:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862202.469730:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874709223311872:12345-192.168.202.9@tcp:8: 00010000:00080000:3.0:1787862202.469778:0:6712:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1787862202.469831:0:6712:0:(genops.c:1385:class_connect()) connect: client c20d7abe-3b31-4da4-909a-c5bb95bfc247, cookie 0x391a6cd368cd9b04 00002000:00100000:3.0:1787862202.469847:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c20d7abe-3b31-4da4-909a-c5bb95bfc247/ffff89a102aa3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862202.469862:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787862202.470376:0:6712:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787862202.470423:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a102aa6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862202.473224:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2351:x1874709223311872:12345-192.168.202.9@tcp:8: Request processed in 3472us (5931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862202.473259:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862202.473305:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1787862202.473313:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874709223312000:12345-192.168.202.9@tcp:8: 00010000:00080000:3.0:1787862202.473351:0:6712:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1787862202.473395:0:6712:0:(genops.c:1385:class_connect()) connect: client c20d7abe-3b31-4da4-909a-c5bb95bfc247, cookie 0x391a6cd368cd9b0b 00002000:00100000:3.0:1787862202.473416:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c20d7abe-3b31-4da4-909a-c5bb95bfc247/ffff89a11ee6d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862202.473447:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787862202.474115:0:6712:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787862202.474164:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a11ee68000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862202.474248:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2351:x1874709223312000:12345-192.168.202.9@tcp:8: Request processed in 933us (6902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862202.474257:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862202.474679:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862202.474739:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862202.474855:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312128 00000100:00100000:3.0:1787862202.474865:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312128 00000100:00100000:3.0:1787862202.474919:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1787862202.474930:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5584:x1874709223312128:12345-192.168.202.9@tcp:33: 00000100:00100000:2.0:1787862202.485459:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312256 00000100:00100000:2.0:1787862202.485494:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312256 00000100:00100000:2.0:1787862202.485592:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 127 00000100:00100000:2.0:1787862202.485605:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223312256:12345-192.168.202.9@tcp:400: 00000100:00100000:2.0:1787862202.485736:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223312256:12345-192.168.202.9@tcp:400: Request processed in 134us (10995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862202.485763:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 127 00010000:00010000:2.0:1787862202.500688:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787862202.519830:0:5871:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 44803us 00000004:00200000:0.0:1787862202.548847:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787862202.549108:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5584:x1874709223312128:12345-192.168.202.9@tcp:33: Request processed in 74171us (74423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862202.549127:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1787862202.767595:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862202.767943:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312384 00000100:00100000:2.0:1787862202.767957:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312384 00000100:00100000:2.0:1787862202.768121:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1787862202.768135:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5625:x1874709223312384:12345-192.168.202.9@tcp:101: 00010000:00010000:2.0:1787862202.768162:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862202.768193:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b210800/0x391a6cd368cd9b12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c04d0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862202.768278:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b211000/0x391a6cd368cd9b19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862202.768294:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b211000/0x391a6cd368cd9b19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862202.768311:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b211000/0x391a6cd368cd9b19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862202.768592:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787862202.768597:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862202.768701:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b211000/0x391a6cd368cd9b19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862202.768738:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b210800/0x391a6cd368cd9b12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04d0 expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862202.768759:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b211000/0x391a6cd368cd9b19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04d0 expref: 7 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862202.768782:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1205e1100) 00010000:00010000:2.0:1787862202.768785:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862202.768789:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b211000, rc 0) 00000100:00100000:2.0:1787862202.768899:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:5625:x1874709223312384:12345-192.168.202.9@tcp:101: Request processed in 767us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862202.768908:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862203.398321:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246402432:0@lo:400: 00000100:00100000:3.0:1787862203.398439:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862203.398531:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862203.398538:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246402304:0@lo:400: 00000100:00100000:3.0:1787862203.398610:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862203.398668:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402432 00000100:00100000:3.0:1787862203.398679:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402432 00000100:00100000:3.0:1787862203.398762:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862203.398773:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246402432:12345-0@lo:400: 00000100:00100000:3.0:1787862203.398856:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246402432:12345-0@lo:400: Request processed in 85us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862203.398865:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862203.398903:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402304 00000100:00100000:3.0:1787862203.398907:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402304 00000100:00100000:3.0:1787862203.398939:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787862203.398946:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246402304:12345-0@lo:400: 00000100:00100000:3.0:1787862203.398980:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246402304:12345-0@lo:400: Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862203.398986:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787862203.399004:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862203.399009:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862203.399095:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246402304:0@lo:400: 00010000:00080000:3.0:1787862203.399113:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1204ba940 x1874709246402432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862203.399124:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246402432:0@lo:400: 00000100:00100000:1.0:1787862203.399502:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246402048:0@lo:400: 00000100:00100000:1.0:1787862203.399559:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862203.399603:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246402560:0@lo:400: 00000100:00100000:1.0:1787862203.399631:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862203.399668:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787862203.399675:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246402176:0@lo:400: 00000100:00100000:1.0:1787862203.399699:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862203.399715:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246402688:0@lo:400: 00000100:00100000:1.0:1787862203.399741:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862203.399771:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402560 00000100:00100000:1.0:1787862203.399777:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402560 00000100:00100000:1.0:1787862203.399821:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402176 00000100:00100000:1.0:1787862203.399825:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402176 00000100:00100000:1.0:1787862203.399840:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787862203.399847:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246402560:12345-0@lo:400: 00000100:00100000:1.0:1787862203.399889:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246402560:12345-0@lo:400: Request processed in 42us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862203.399909:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787862203.399923:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787862203.399929:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246402176:12345-0@lo:400: 00000100:00100000:1.0:1787862203.399962:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246402176:12345-0@lo:400: Request processed in 34us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862203.399967:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787862203.399997:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246402176:0@lo:400: 00000100:00100000:1.0:1787862203.400008:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246402560:0@lo:400: 00000100:00100000:3.0:1787862203.401638:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402048 00000100:00100000:3.0:1787862203.401658:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402048 00000100:00100000:3.0:1787862203.401728:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787862203.401739:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246402048:12345-0@lo:400: 00000100:00100000:3.0:1787862203.401859:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246402048:12345-0@lo:400: Request processed in 122us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862203.401867:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787862203.401913:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402688 00000100:00100000:3.0:1787862203.401934:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402688 00000100:00100000:3.0:1787862203.401988:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862203.401995:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a0083892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246402688:12345-0@lo:400: 00000100:00100000:3.0:1787862203.402035:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a0083892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246402688:12345-0@lo:400: Request processed in 42us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862203.402078:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787862203.402096:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862203.402102:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787862203.402690:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1204bb0c0 x1874709246402688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862203.402703:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787862203.402724:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246402688:0@lo:400: 00000100:00100000:1.0:1787862203.402737:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246402048:0@lo:400: 00010000:00010000:3.0:1787862203.526154:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862203.908594:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a008389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246402816:0@lo:13: 00000100:00100000:2.0:1787862203.908714:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862203.908947:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402816 00000100:00100000:0.0:1787862203.908959:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402816 00000100:00100000:0.0:1787862203.909033:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862203.909074:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246402816:12345-0@lo:13: 00002000:00000024:0.0:1787862203.909107:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862203.909161:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246402816:12345-0@lo:13: Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862203.909169:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787862203.909267:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a008389a40 x1874709246402816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862203.909290:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a008389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246402816:0@lo:13: 00010000:00010000:2.0:1787862204.551624:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862205.249248:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862205.250344:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312512 00000100:00100000:1.0:1787862205.250360:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312512 00000100:00080000:3.0:1787862205.250553:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862205.250629:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862205.250643:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:5678:x1874709223312512:12345-192.168.202.9@tcp:41: 00000004:00000024:1.0:1787862205.250712:0:5869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787862205.251084:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:5678:x1874709223312512:12345-192.168.202.9@tcp:41: Request processed in 444us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862205.251092:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862205.273683:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862205.273970:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312640 00000100:00100000:0.0:1787862205.273984:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312640 00000100:00100000:0.0:1787862205.274118:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1787862205.274133:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5678:x1874709223312640:12345-192.168.202.9@tcp:13: 00002000:00000024:0.0:1787862205.275344:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862205.275561:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5678:x1874709223312640:12345-192.168.202.9@tcp:13: Request processed in 1425us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862205.275574:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00080000:3.0:1787862205.283623:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862205.286816:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862205.287118:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312768 00000100:00100000:3.0:1787862205.287132:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312768 00000100:00100000:3.0:1787862205.287250:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862205.287263:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5678:x1874709223312768:12345-192.168.202.9@tcp:13: 00002000:00000024:3.0:1787862205.287323:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862205.287410:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:5678:x1874709223312768:12345-192.168.202.9@tcp:13: Request processed in 150us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862205.287418:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00080000:0.0:1787862205.288909:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787862205.572626:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862206.471022:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246402944:0@lo:13: 00000100:00100000:0.0:1787862206.471135:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862206.471367:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246402944 00000100:00100000:3.0:1787862206.471377:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246402944 00000100:00100000:3.0:1787862206.471442:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787862206.471453:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246402944:12345-0@lo:13: 00002000:00000024:3.0:1787862206.471479:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862206.471527:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246402944:12345-0@lo:13: Request processed in 76us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862206.471535:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787862206.471590:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862206.471621:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a5a40 x1874709246402944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862206.471644:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246402944:0@lo:13: 00000001:00100000:3.0:1787862206.531602:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000001:00100000:3.0:1787862206.550600:0:5890:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00010000:00010000:2.0:1787862206.596330:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787862207.579964:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00010000:00010000:2.0:1787862207.625007:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862207.830111:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862207.830159:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862207.830288:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313152 00000100:00100000:1.0:1787862207.830300:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313152 00000100:00100000:1.0:1787862207.830393:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862207.830404:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223313152:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1787862207.830500:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223313152:12345-192.168.202.9@tcp:400: Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862207.830508:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00080000:0.0:1787862207.830698:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862207.831095:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223312896 00000100:00100000:3.0:1787862207.831104:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223312896 00000100:00100000:3.0:1787862207.831160:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:3.0:1787862207.831169:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223312896:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1787862207.831214:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223312896:12345-192.168.202.9@tcp:400: Request processed in 46us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862207.831221:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:3.0:1787862207.853524:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862207.853567:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862207.853600:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313024 00000100:00100000:3.0:1787862207.853611:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313024 00000100:00100000:3.0:1787862207.853700:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:3.0:1787862207.853712:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223313024:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1787862207.853825:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223313024:12345-192.168.202.9@tcp:400: Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862207.853833:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:3.0:1787862207.853861:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313280 00000100:00100000:3.0:1787862207.853864:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313280 00000100:00100000:3.0:1787862207.853894:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1787862207.853900:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223313280:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1787862207.853929:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223313280:12345-192.168.202.9@tcp:400: Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862207.853935:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00080000:3.0:1787862207.853952:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862207.853975:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787862208.303842:0:8312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787862208.518784:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246403200:0@lo:400: 00000100:00100000:1.0:1787862208.518897:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862208.518974:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246403712:0@lo:400: 00000100:00100000:1.0:1787862208.519004:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862208.519059:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862208.519065:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246403072:0@lo:400: 00000100:00100000:1.0:1787862208.519099:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862208.519128:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246403584:0@lo:400: 00000100:00100000:1.0:1787862208.519151:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862208.519178:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246403328:0@lo:400: 00000100:00100000:1.0:1787862208.519232:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862208.519251:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862208.519258:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246403456:0@lo:400: 00000100:00100000:1.0:1787862208.519282:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862208.519317:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403200 00000100:00100000:1.0:1787862208.519327:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403200 00000100:00100000:1.0:1787862208.519379:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403584 00000100:00100000:1.0:1787862208.519382:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403584 00000100:00100000:1.0:1787862208.519406:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403328 00000100:00100000:3.0:1787862208.519567:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787862208.519579:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120581a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246403200:12345-0@lo:400: 00000100:00100000:3.0:1787862208.519648:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120581a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246403200:12345-0@lo:400: Request processed in 72us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862208.519656:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787862208.519678:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787862208.519686:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120582940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246403584:12345-0@lo:400: 00000100:00100000:3.0:1787862208.519715:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120582940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246403584:12345-0@lo:400: Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862208.519721:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787862208.519742:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403712 00000100:00100000:3.0:1787862208.519745:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403712 00000100:00100000:3.0:1787862208.519788:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403456 00000100:00100000:3.0:1787862208.519792:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403456 00000100:00100000:3.0:1787862208.519809:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862208.519815:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246403712:12345-0@lo:400: 00000100:00100000:3.0:1787862208.519849:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246403712:12345-0@lo:400: Request processed in 33us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862208.519855:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862208.519869:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862208.519875:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246403456:12345-0@lo:400: 00000100:00100000:3.0:1787862208.519907:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246403456:12345-0@lo:400: Request processed in 32us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862208.519913:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787862208.519928:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862208.519932:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862208.519935:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787862208.519982:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a00838bc00 x1874709246403456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862208.519998:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246403456:0@lo:400: 00000100:00100000:3.0:1787862208.520067:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246403584:0@lo:400: 00000100:00100000:3.0:1787862208.520083:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246403200:0@lo:400: 00010000:00080000:3.0:1787862208.520094:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1205812c0 x1874709246403712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862208.520104:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246403712:0@lo:400: 00000100:00100000:1.0:1787862208.520216:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403328 00000100:00100000:1.0:1787862208.520246:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862208.520260:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246403328:12345-0@lo:400: 00000100:00100000:1.0:1787862208.520299:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246403328:12345-0@lo:400: Request processed in 39us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862208.520305:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862208.520330:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403072 00000100:00100000:1.0:1787862208.520333:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403072 00000100:00100000:1.0:1787862208.520356:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787862208.520364:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246403072:12345-0@lo:400: 00000100:00100000:1.0:1787862208.520399:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246403072:12345-0@lo:400: Request processed in 36us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862208.520407:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787862208.525344:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862208.525460:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246403328:0@lo:400: 00000100:00100000:3.0:1787862208.525515:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246403072:0@lo:400: 00010000:00010000:2.0:1787862208.656495:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862209.028428:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246403840:0@lo:13: 00000100:00100000:0.0:1787862209.028530:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862209.028892:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403840 00000100:00100000:2.0:1787862209.028903:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403840 00000100:00100000:2.0:1787862209.028976:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862209.028986:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246403840:12345-0@lo:13: 00002000:00000024:2.0:1787862209.029037:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862209.029301:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246403840:12345-0@lo:13: Request processed in 316us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862209.029310:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787862209.037020:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c42c000 x1874709246403840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862209.037101:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246403840:0@lo:13: 00010000:00010000:3.0:1787862209.682519:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862210.699345:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862211.589884:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246403968:0@lo:13: 00000100:00100000:1.0:1787862211.589974:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862211.591961:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246403968 00000100:00100000:2.0:1787862211.591977:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246403968 00000100:00100000:2.0:1787862211.592063:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862211.592077:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246403968:12345-0@lo:13: 00002000:00000024:2.0:1787862211.592140:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862211.592433:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246403968:12345-0@lo:13: Request processed in 359us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862211.592442:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787862211.593147:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862211.593447:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a4f00 x1874709246403968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862211.593484:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246403968:0@lo:13: 00010000:00010000:3.0:1787862211.716701:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787862212.699206:0:8460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6189d430 20000000:00000080:2.0:1787862212.699227:0:8460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a13d38cc00 uarg=0000000000000000 20000000:01000000:2.0:1787862212.699265:0:8460:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787862212.699267:0:8460:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787862212.699389:0:8460:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787862212.699395:0:8460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787862212.699401:0:8460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787862212.699420:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787862212.699423:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787862212.699826:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787862212.699831:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787862212.701567:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787862212.702437:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787862212.702516:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787862212.702557:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787862212.702571:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787862212.702574:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787862212.703561:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787862212.704339:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787862212.704391:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787862212.704441:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787862212.704456:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787862212.704458:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787862212.705648:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787862212.706467:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787862212.706540:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787862212.706580:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787862212.706594:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787862212.706597:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787862212.707597:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787862212.711342:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787862212.711405:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787862212.711463:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1787862212.711484:0:8460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787862212.711510:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711531:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711552:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711559:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711567:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711575:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711582:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711589:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711599:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711607:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711615:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711665:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711694:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 9 pid: 5863 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.711713:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404096:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862212.711854:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711862:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 9 pid: 5862 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.711871:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404224:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862212.711905:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.711915:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 18 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.711925:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404352:0@lo:104: 00000100:00100000:1.0:1787862212.711969:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862212.712004:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.712011:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 18 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.712019:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404480:0@lo:104: 00000100:00100000:1.0:1787862212.712082:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862212.712120:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.712128:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 18 pid: 5863 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.712136:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404608:0@lo:104: 00010000:00010000:1.0:1787862212.712160:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.712168:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 18 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.712176:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404736:0@lo:104: 00010000:00010000:1.0:1787862212.712198:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.712206:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 18 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.712213:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404864:0@lo:104: 00010000:00010000:1.0:1787862212.712236:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.712243:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 18 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.712250:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404992:0@lo:104: 00010000:00010000:1.0:1787862212.712273:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.712290:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 18 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.712299:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246405120:0@lo:104: 00000100:00100000:1.0:1787862212.712320:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862212.712687:0:5851:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787862212.712707:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.712748:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.712757:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.712765:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.712773:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.712782:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246404352 00000100:00100000:2.0:1787862212.712789:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246404352 00000100:00100000:2.0:1787862212.712836:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246404480 00000100:00100000:2.0:1787862212.712839:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246404480 00000100:00100000:2.0:1787862212.712850:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246404608 00000100:00100000:2.0:1787862212.712852:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246404608 00000100:00100000:2.0:1787862212.712859:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246404736 00000100:00100000:2.0:1787862212.712861:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246404736 00000100:00100000:2.0:1787862212.712868:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246404864 00000100:00100000:2.0:1787862212.712870:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246404864 00000100:00100000:2.0:1787862212.712877:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246404992 00000100:00100000:2.0:1787862212.712879:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246404992 00000100:00100000:2.0:1787862212.712887:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405120 00000100:00100000:2.0:1787862212.712890:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405120 00000100:00100000:2.0:1787862212.712920:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862212.712932:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:8460:x1874709246404352:12345-0@lo:104: 00010000:00010000:2.0:1787862212.712949:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713011:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862212.713017:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+9:8460:x1874709246404352:12345-0@lo:104: Request processed in 88us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713036:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862212.713082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862212.713090:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00704c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+8:8460:x1874709246404480:12345-0@lo:104: 00010000:00010000:2.0:1787862212.713098:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713137:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787862212.713143:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00704c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+8:8460:x1874709246404480:12345-0@lo:104: Request processed in 55us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862212.713184:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862212.713191:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+7:8460:x1874709246404608:12345-0@lo:104: 00010000:00010000:2.0:1787862212.713199:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713224:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787862212.713229:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+7:8460:x1874709246404608:12345-0@lo:104: Request processed in 41us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713235:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862212.713245:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862212.713250:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+6:8460:x1874709246404736:12345-0@lo:104: 00010000:00010000:2.0:1787862212.713264:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713300:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787862212.713305:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+6:8460:x1874709246404736:12345-0@lo:104: Request processed in 55us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713317:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862212.713330:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862212.713335:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:8460:x1874709246404864:12345-0@lo:104: 00010000:00010000:2.0:1787862212.713344:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713371:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787862212.713376:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:8460:x1874709246404864:12345-0@lo:104: Request processed in 42us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713382:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862212.713393:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862212.713398:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:8460:x1874709246404992:12345-0@lo:104: 00010000:00010000:2.0:1787862212.713406:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713430:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787862212.713434:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:8460:x1874709246404992:12345-0@lo:104: Request processed in 37us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713440:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862212.713450:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862212.713456:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:8460:x1874709246405120:12345-0@lo:104: 00010000:00010000:2.0:1787862212.713463:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713490:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787862212.713494:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:8460:x1874709246405120:12345-0@lo:104: Request processed in 39us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.713505:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787862212.713530:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787862212.713536:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713542:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b210400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.713546:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713555:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.713562:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.713568:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.713610:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713616:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.713637:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713645:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9acc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9ad3 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713661:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787862212.713664:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713680:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030800 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.713684:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713691:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.713698:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.713703:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.713718:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713736:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.713743:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713749:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030800/0x391a6cd368cd9aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9aa9 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713759:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787862212.713762:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713768:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.713771:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713790:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.713796:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.713801:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.713814:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713820:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.713836:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713842:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a8d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713854:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787862212.713856:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713861:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031e00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.713864:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713870:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.713876:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.713887:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.713900:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713906:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.713911:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713917:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031e00/0x391a6cd368cd9a78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a7f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713925:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787862212.713928:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713933:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9e00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.713937:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713942:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.713949:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.713955:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.713966:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713970:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.713980:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713987:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9e00/0x391a6cd368cd9a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a71 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.713995:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862212.713998:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714004:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.714007:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714013:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.714019:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.714024:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.714063:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714070:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.714074:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714079:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a104c2d000/0x391a6cd368cd9a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a47 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714087:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862212.714096:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714102:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862212.714105:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714113:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862212.714119:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862212.714123:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862212.714136:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714142:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862212.714146:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714152:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a8a00/0x391a6cd368cd9a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a1d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714164:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862212.714166:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862212.714168:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862212.714177:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862212.714201:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a12077ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405248:0@lo:103: 00000100:00100000:2.0:1787862212.714241:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714265:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120779a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405760:0@lo:103: 00000100:00100000:2.0:1787862212.714308:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714332:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787862212.714337:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a12077b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405376:0@lo:103: 00000100:00100000:2.0:1787862212.714359:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714375:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405888:0@lo:103: 00000100:00100000:2.0:1787862212.714397:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714419:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a12077a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246405504:0@lo:103: 00000100:00100000:2.0:1787862212.714443:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714452:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246406016:0@lo:103: 00000100:00100000:2.0:1787862212.714472:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714483:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862212.714488:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a12077b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246405632:0@lo:103: 00000100:00100000:2.0:1787862212.714513:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862212.714540:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405248 00000100:00100000:2.0:1787862212.714547:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405248 00010000:00010000:2.0:1787862212.714574:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 19 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714593:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405760 00000100:00100000:2.0:1787862212.714596:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405760 00010000:00010000:2.0:1787862212.714607:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 20 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714617:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405376 00000100:00100000:2.0:1787862212.714619:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405376 00010000:00010000:2.0:1787862212.714627:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 21 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714635:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405888 00000100:00100000:2.0:1787862212.714643:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405888 00010000:00010000:2.0:1787862212.714657:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 22 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714669:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405504 00000100:00100000:2.0:1787862212.714671:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405504 00010000:00010000:2.0:1787862212.714680:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 23 pid: 5863 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714690:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406016 00000100:00100000:2.0:1787862212.714693:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406016 00010000:00010000:2.0:1787862212.714703:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 24 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714711:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246405632 00000100:00100000:2.0:1787862212.714713:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246405632 00010000:00010000:2.0:1787862212.714736:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 25 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862212.714748:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862212.714756:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+25:3329:x1874709246405248:12345-0@lo:103: 00010000:00010000:2.0:1787862212.714769:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.714774:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 25 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714784:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 25 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714802:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.714835:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+25:3329:x1874709246405248:12345-0@lo:103: Request processed in 79us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.714842:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862212.714862:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862212.714868:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+24:3329:x1874709246405760:12345-0@lo:103: 00010000:00010000:2.0:1787862212.714876:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.714880:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 24 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714889:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 24 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714898:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.714919:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+24:3329:x1874709246405760:12345-0@lo:103: Request processed in 52us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.714926:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862212.714937:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862212.714943:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+23:3329:x1874709246405376:12345-0@lo:103: 00010000:00010000:2.0:1787862212.714950:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.714955:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 23 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714963:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 23 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.714972:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.714991:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+23:3329:x1874709246405376:12345-0@lo:103: Request processed in 49us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.714997:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862212.715013:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862212.715019:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+22:3329:x1874709246405888:12345-0@lo:103: 00010000:00010000:2.0:1787862212.715026:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.715037:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 22 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715090:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 22 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715100:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.715131:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+22:3329:x1874709246405888:12345-0@lo:103: Request processed in 113us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.715137:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862212.715150:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862212.715156:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+21:3327:x1874709246405504:12345-0@lo:103: 00010000:00010000:2.0:1787862212.715164:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.715168:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 21 pid: 5863 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715175:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 21 pid: 5863 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715184:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.715209:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+21:3327:x1874709246405504:12345-0@lo:103: Request processed in 53us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.715216:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862212.715228:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862212.715234:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3327:x1874709246406016:12345-0@lo:103: 00010000:00010000:2.0:1787862212.715243:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.715247:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 20 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715266:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 20 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715276:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.715299:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3327:x1874709246406016:12345-0@lo:103: Request processed in 65us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.715305:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862212.715318:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862212.715324:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246405632:12345-0@lo:103: 00010000:00010000:2.0:1787862212.715333:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862212.715338:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 19 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715346:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 19 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.715355:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862212.715375:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246405632:12345-0@lo:103: Request processed in 51us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862212.715381:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862212.715449:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a12077b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405376:0@lo:103: 00000100:00100000:2.0:1787862212.715458:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405888:0@lo:103: 00000100:00100000:2.0:1787862212.715466:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a12077ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405248:0@lo:103: 00000100:00100000:2.0:1787862212.715473:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120779a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246405760:0@lo:103: 00000100:00100000:2.0:1787862212.715509:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a12077b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246405632:0@lo:103: 00000100:00100000:2.0:1787862212.715525:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a12077a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246405504:0@lo:103: 00000100:00100000:2.0:1787862212.715532:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246406016:0@lo:103: 00010000:00010000:1.0:1787862212.716109:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211e00/0x391a6cd368cd9ad3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9acc expref: 18 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716125:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404352:0@lo:104: 00010000:00010000:1.0:1787862212.716138:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9aa2 expref: 17 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716146:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404480:0@lo:104: 00010000:00010000:1.0:1787862212.716156:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9a8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9a86 expref: 16 pid: 5863 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716164:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404608:0@lo:104: 00010000:00010000:1.0:1787862212.716174:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cd9a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9a78 expref: 15 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716183:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404736:0@lo:104: 00010000:00010000:1.0:1787862212.716193:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030200/0x391a6cd368cd9a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9a6a expref: 14 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716202:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404864:0@lo:104: 00010000:00010000:1.0:1787862212.716212:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030000/0x391a6cd368cd9a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9a40 expref: 13 pid: 5860 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716234:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404992:0@lo:104: 00010000:00010000:1.0:1787862212.716248:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2d600/0x391a6cd368cd9a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9a16 expref: 12 pid: 5862 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862212.716256:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246405120:0@lo:104: 00000100:00100000:1.0:1787862212.716849:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862212.716885:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862212.717116:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404096:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862212.717128:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1874709246404224:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862212.717166:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862212.720412:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313408 00000100:00100000:0.0:1787862212.720429:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313408 00010000:00010000:0.0:1787862212.720484:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 10 pid: 5863 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862212.720981:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313536 00000100:00100000:0.0:1787862212.720987:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313536 00010000:00010000:0.0:1787862212.721006:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 11 pid: 5862 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862212.721025:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1787862212.721036:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:2353:x1874709223313408:12345-192.168.202.9@tcp:103: 00010000:00010000:0.0:1787862212.721086:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862212.721094:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 11 pid: 5863 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721109:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 11 pid: 5863 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721130:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210c00/0x391a6cd368cd9ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0475 expref: 11 pid: 5863 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721149:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862212.721237:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223313408:12345-192.168.202.9@tcp:103: Request processed in 202us (4389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862212.721245:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1787862212.721264:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1787862212.721283:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:2353:x1874709223313536:12345-192.168.202.9@tcp:103: 00010000:00010000:0.0:1787862212.721292:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862212.721297:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 9 pid: 5862 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721307:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 9 pid: 5862 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721318:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030400/0x391a6cd368cd9ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c046e expref: 9 pid: 5862 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721332:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721342:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721360:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721368:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721376:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721382:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721396:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8c00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862212.721401:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721412:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721427:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862212.721438:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862212.721461:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:2353:x1874709223313536:12345-192.168.202.9@tcp:103: Request processed in 190us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862212.721468:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00010000:00010000:2.0:1787862212.721737:0:8460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.721748:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862212.721754:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a8c00/0x391a6cd368cd9b20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862212.740757:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862212.952997:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862212.953061:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862212.953104:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862212.953153:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313792 00000100:00100000:3.0:1787862212.953164:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313792 00000100:00100000:3.0:1787862212.953264:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313920 00000100:00100000:3.0:1787862212.953268:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313920 00000100:00100000:3.0:1787862212.953298:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862212.953311:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223313792:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1787862212.953397:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223313792:12345-192.168.202.9@tcp:400: Request processed in 88us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862212.953408:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862212.953449:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1787862212.953456:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223313920:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1787862212.953486:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223313920:12345-192.168.202.9@tcp:400: Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862212.953493:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1787862212.953515:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223313664 00000100:00100000:3.0:1787862212.953519:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223313664 00000100:00100000:3.0:1787862212.953553:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1787862212.953561:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223313664:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1787862212.953591:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223313664:12345-192.168.202.9@tcp:400: Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862212.953598:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00080000:3.0:1787862212.953619:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862212.953626:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862212.953627:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862213.636465:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246406144:0@lo:400: 00000100:00100000:2.0:1787862213.636561:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862213.636652:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406144 00000100:00100000:3.0:1787862213.636663:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406144 00000100:00100000:3.0:1787862213.636744:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787862213.636758:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3328:x1874709246406144:12345-0@lo:400: 00000100:00100000:0.0:1787862213.636787:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246406528:0@lo:400: 00000100:00100000:0.0:1787862213.636858:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.636909:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406528 00000100:00100000:0.0:1787862213.636913:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406528 00000100:00100000:0.0:1787862213.636967:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862213.636975:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246406528:12345-0@lo:400: 00000100:00100000:0.0:1787862213.637019:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246406528:12345-0@lo:400: Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.637027:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787862213.637080:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862213.637116:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4780 x1874709246406528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862213.637134:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246406528:0@lo:400: 00000100:00100000:0.0:1787862213.637199:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246406400:0@lo:400: 00000100:00100000:0.0:1787862213.637231:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.637254:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862213.637260:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246406272:0@lo:400: 00000100:00100000:0.0:1787862213.637280:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.637308:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406400 00000100:00100000:0.0:1787862213.637312:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406400 00000100:00100000:0.0:1787862213.637343:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406272 00000100:00100000:0.0:1787862213.637345:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406272 00000100:00100000:0.0:1787862213.637358:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862213.637365:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246406400:12345-0@lo:400: 00000100:00100000:0.0:1787862213.637402:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246406400:12345-0@lo:400: Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.637409:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862213.637421:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862213.637427:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246406272:12345-0@lo:400: 00000100:00100000:0.0:1787862213.637456:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246406272:12345-0@lo:400: Request processed in 29us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.637462:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787862213.637485:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862213.637502:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246406272:0@lo:400: 00000100:00100000:0.0:1787862213.637513:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246406400:0@lo:400: 00000100:00100000:1.0:1787862213.644245:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246406784:0@lo:400: 00000100:00100000:1.0:1787862213.644351:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862213.644494:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406784 00000100:00100000:1.0:1787862213.644505:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406784 00000100:00100000:1.0:1787862213.644588:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787862213.644602:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246406784:12345-0@lo:400: 00000100:00100000:1.0:1787862213.644683:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246406784:12345-0@lo:400: Request processed in 70us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.644693:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787862213.644752:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a61c0 x1874709246406784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862213.644772:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246406784:0@lo:400: 00000100:00080000:1.0:1787862213.644800:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862213.645346:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862213.645365:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246406656:0@lo:400: 00000100:00100000:0.0:1787862213.645431:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862213.646999:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406656 00000100:00100000:1.0:1787862213.647015:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406656 00000100:00100000:1.0:1787862213.647145:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862213.647155:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246406656:12345-0@lo:400: 00000100:00100000:1.0:1787862213.647266:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246406656:12345-0@lo:400: Request processed in 112us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.647274:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787862213.647317:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862213.647499:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:3328:x1874709246406144:12345-0@lo:400: Request processed in 10741us (10934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.647511:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787862213.649942:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246406656:0@lo:400: 00000100:00100000:2.0:1787862213.650200:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246406144:0@lo:400: 00010000:00010000:2.0:1787862213.769939:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862213.829629:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787862213.829636:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a102aa4000 from 39 10000000:01000000:2.0:1787862213.829641:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862213.829703:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.829723:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.829763:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.830981:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246406912:0@lo:101: 00000100:00100000:2.0:1787862213.831113:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.831362:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.838074:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246406912 00000100:00100000:3.0:1787862213.838090:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246406912 00000100:00100000:3.0:1787862213.838484:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787862213.838497:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+12:5865:x1874709246406912:12345-0@lo:101: 00010000:00010000:3.0:1787862213.838516:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862213.838555:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2c200/0x391a6cd368cd9b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b27 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.838592:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2c200/0x391a6cd368cd9b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b27 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.838606:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2c200/0x391a6cd368cd9b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b27 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.838617:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c200, rc 0) 00000100:00100000:3.0:1787862213.838728:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246406912:12345-0@lo:101: Request processed in 235us (7616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.838736:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787862213.838864:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246406912:0@lo:101: 00010000:00010000:2.0:1787862213.838887:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.838898:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.840472:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407040:0@lo:501: 00000100:00100000:2.0:1787862213.840536:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.841476:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.841599:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407040 00000100:00100000:0.0:1787862213.841607:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407040 00000100:00100000:0.0:1787862213.841656:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787862213.841665:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246407040:12345-0@lo:501: 00000100:00100000:0.0:1787862213.848113:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246407040:12345-0@lo:501: Request processed in 6440us (7568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.848200:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787862213.849902:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407040:0@lo:501: 00000100:00100000:3.0:1787862213.850083:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407168:0@lo:503: 00000100:00100000:3.0:1787862213.850247:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862213.850289:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.850526:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407168 00000100:00100000:1.0:1787862213.850533:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407168 00000100:00100000:1.0:1787862213.850600:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787862213.850613:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246407168:12345-0@lo:503: 00000100:00100000:1.0:1787862213.851085:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246407168:12345-0@lo:503: Request processed in 472us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.851096:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787862213.855779:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407168:0@lo:503: 00000100:00100000:1.0:1787862213.857633:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8476:1874709246407296:0@lo:502: 00000100:00100000:1.0:1787862213.857764:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862213.857954:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407296 00000100:00100000:3.0:1787862213.857963:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407296 00000100:00100000:3.0:1787862213.858029:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787862213.858072:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:8476:x1874709246407296:12345-0@lo:502: 00000100:00100000:1.0:1787862213.858857:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.859031:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:8476:x1874709246407296:12345-0@lo:502: Request processed in 989us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.859059:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787862213.861314:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8476:1874709246407296:0@lo:502: 00000100:00100000:1.0:1787862213.861424:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8476:1874709246407424:0@lo:502: 00000100:00100000:1.0:1787862213.861504:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862213.861550:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.861869:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407424 00000100:00100000:3.0:1787862213.861878:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407424 00000100:00100000:3.0:1787862213.861939:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787862213.861958:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:8476:x1874709246407424:12345-0@lo:502: 00000100:00100000:3.0:1787862213.862655:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:8476:x1874709246407424:12345-0@lo:502: Request processed in 694us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.862750:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787862213.863189:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8476:1874709246407424:0@lo:502: 00000040:00080000:1.0:1787862213.863232:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787862213.863612:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787862213.863647:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862213.863661:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.863683:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862213.863694:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787862213.863696:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787862213.863700:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787862213.863756:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.863765:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.863775:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862213.863804:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407552:0@lo:101: 00000100:00100000:3.0:1787862213.863856:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862213.863899:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.864590:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407552 00000100:00100000:0.0:1787862213.864601:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407552 00000100:00100000:0.0:1787862213.864667:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787862213.864687:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+13:5865:x1874709246407552:12345-0@lo:101: 00010000:00010000:0.0:1787862213.864702:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862213.864732:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030400/0x391a6cd368cd9b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b35 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.864768:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030400/0x391a6cd368cd9b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b35 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.864782:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030400/0x391a6cd368cd9b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b35 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.864803:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030400, rc 0) 00000100:00100000:0.0:1787862213.864886:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246407552:12345-0@lo:101: Request processed in 202us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.864895:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787862213.865296:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407552:0@lo:101: 00010000:00010000:2.0:1787862213.865318:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.865330:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.865931:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407680:0@lo:501: 00000100:00100000:2.0:1787862213.865984:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.866023:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.866298:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407680 00000100:00100000:0.0:1787862213.866306:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407680 00000100:00100000:0.0:1787862213.866366:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787862213.866380:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246407680:12345-0@lo:501: 00000100:00100000:0.0:1787862213.867083:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246407680:12345-0@lo:501: Request processed in 659us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.867096:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787862213.867592:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407680:0@lo:501: 00000100:00100000:2.0:1787862213.867650:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407808:0@lo:503: 00000100:00100000:2.0:1787862213.867724:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.867767:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.868019:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407808 00000100:00100000:1.0:1787862213.868026:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407808 00000100:00100000:1.0:1787862213.868109:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787862213.868120:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246407808:12345-0@lo:503: 00000100:00100000:1.0:1787862213.868607:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246407808:12345-0@lo:503: Request processed in 487us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.868624:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787862213.874308:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246407808:0@lo:503: 00000100:00100000:0.0:1787862213.879899:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8477:1874709246407936:0@lo:502: 00000100:00100000:0.0:1787862213.880006:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.880137:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128180 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.882575:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246407936 00000100:00100000:3.0:1787862213.882613:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246407936 00000100:00100000:2.0:1787862213.883291:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787862213.883308:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8477:x1874709246407936:12345-0@lo:502: 00000100:00100000:2.0:1787862213.883647:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8477:x1874709246407936:12345-0@lo:502: Request processed in 342us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.883657:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787862213.883805:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8477:1874709246407936:0@lo:502: 00000020:01000000:0.0:1787862213.883852:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862213.883864:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862213.883867:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787862213.883875:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787862213.883923:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8477:1874709246408064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.883976:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.886227:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.886514:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408064 00000100:00100000:1.0:1787862213.886525:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408064 00000100:00100000:1.0:1787862213.886584:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787862213.886595:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8477:x1874709246408064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862213.886949:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:8477:x1874709246408064:12345-0@lo:502:llog_process_th.0 Request processed in 354us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.886959:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787862213.887371:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8477:1874709246408064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862213.887421:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862213.887430:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862213.887433:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787862213.887439:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787862213.889584:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787862213.889632:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787862213.889648:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862213.889662:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862213.889952:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787862213.889955:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a1102e9000 from 39 10000000:01000000:1.0:1787862213.889958:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787862213.890012:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862213.890022:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862213.890034:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862213.890279:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862213.890847:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862213.890937:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.891056:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408192 00000100:00100000:3.0:1787862213.891064:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408192 00000100:00100000:0.0:1787862213.891347:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787862213.891361:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:5865:x1874709246408192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862213.891379:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862213.891467:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100031e00/0x391a6cd368cd9b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b43 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.891503:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100031e00/0x391a6cd368cd9b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b43 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.891532:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100031e00/0x391a6cd368cd9b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b43 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.891542:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031e00, rc 0) 00000100:00100000:0.0:1787862213.891651:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246408192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.891658:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787862213.892275:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862213.892301:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862213.892314:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.892586:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.892632:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.892775:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.896919:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408320 00000100:00100000:0.0:1787862213.896937:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408320 00000100:00100000:0.0:1787862213.897111:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787862213.897124:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246408320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.897898:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246408320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 774us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.897910:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787862213.898013:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862213.898155:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862213.898218:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862213.906745:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36300 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.907308:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408448 00000100:00100000:2.0:1787862213.907323:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408448 00000100:00100000:2.0:1787862213.907694:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787862213.907720:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246408448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.908259:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246408448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 551us (10038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.908271:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787862213.909204:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.910554:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8478:1874709246408576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.910643:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.910817:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d1286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.910947:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408576 00000100:00100000:2.0:1787862213.910957:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408576 00000100:00100000:2.0:1787862213.911015:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787862213.911026:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8478:x1874709246408576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862213.911912:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8478:x1874709246408576:12345-0@lo:502:llog_process_th.0 Request processed in 883us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.911936:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787862213.912344:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8478:1874709246408576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862213.912482:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8478:1874709246408704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862213.912533:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862213.912572:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.912766:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408704 00000100:00100000:0.0:1787862213.912772:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408704 00000100:00100000:0.0:1787862213.912806:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787862213.912816:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8478:x1874709246408704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.913036:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:8478:x1874709246408704:12345-0@lo:502:llog_process_th.0 Request processed in 221us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.913067:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787862213.913304:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8478:1874709246408704:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787862213.913328:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787862213.913641:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787862213.913881:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862213.913893:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.913904:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862213.913915:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787862213.913918:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787862213.913921:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862213.913954:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.913962:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.913971:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862213.913990:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.914031:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.914102:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.914228:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408832 00000100:00100000:2.0:1787862213.914234:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408832 00000100:00100000:2.0:1787862213.914269:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787862213.914279:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:5865:x1874709246408832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862213.914292:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862213.914311:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b51 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.914355:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b51 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.914367:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b51 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.914377:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b210800, rc 0) 00000100:00100000:2.0:1787862213.914522:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246408832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.914530:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787862213.914831:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862213.914849:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.914859:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862213.914912:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.914953:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.915080:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.916952:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246408960 00000100:00100000:3.0:1787862213.916968:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246408960 00000100:00100000:3.0:1787862213.917058:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787862213.917070:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246408960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862213.917900:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246408960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 829us (2943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.917910:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787862213.918247:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246408960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.918316:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.918577:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.918622:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.918683:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409088 00000100:00100000:1.0:1787862213.918689:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409088 00000100:00100000:2.0:1787862213.918859:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787862213.918874:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246409088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.919121:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246409088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.919207:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787862213.919622:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862213.921964:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8479:1874709246409216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862213.922100:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.922664:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409216 00000100:00100000:2.0:1787862213.922804:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409216 00000100:00100000:2.0:1787862213.922873:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787862213.922885:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8479:x1874709246409216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862213.923302:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.923618:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8479:x1874709246409216:12345-0@lo:502:llog_process_th.0 Request processed in 734us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.923627:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787862213.923831:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8479:1874709246409216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862213.923873:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862213.923886:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862213.923890:0:8479:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787862213.923900:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787862213.923934:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8479:1874709246409344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862213.923989:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862213.924018:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.924251:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409344 00000100:00100000:1.0:1787862213.924257:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409344 00000100:00100000:1.0:1787862213.924344:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787862213.924354:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8479:x1874709246409344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862213.924537:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:8479:x1874709246409344:12345-0@lo:502:llog_process_th.0 Request processed in 184us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.924543:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787862213.924612:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8479:1874709246409344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862213.924632:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862213.924637:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862213.924639:0:8479:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787862213.924644:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787862213.925898:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787862213.925931:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787862213.925945:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.925960:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862213.925972:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787862213.925975:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a102b43800 from 39 10000000:01000000:2.0:1787862213.925978:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862213.926019:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.926029:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.926065:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.926090:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.926186:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.926701:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.926904:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409472 00000100:00100000:0.0:1787862213.926920:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409472 00000100:00100000:0.0:1787862213.926970:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787862213.926981:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246409472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862213.926995:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862213.927014:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030800/0x391a6cd368cd9b66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b5f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.927079:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030800/0x391a6cd368cd9b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b5f expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.927091:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030800/0x391a6cd368cd9b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b5f expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.927102:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030800, rc 0) 00000100:00100000:0.0:1787862213.927171:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246409472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.927179:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787862213.927347:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862213.927364:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.927374:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.927447:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.927481:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.927511:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.927813:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409600 00000100:00100000:0.0:1787862213.927819:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409600 00000100:00100000:0.0:1787862213.927841:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787862213.927848:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246409600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.928193:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246409600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.928202:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787862213.929114:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.929181:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.929244:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.929283:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.929498:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409728 00000100:00100000:0.0:1787862213.929511:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409728 00000100:00100000:0.0:1787862213.929544:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787862213.929554:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246409728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.929875:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246409728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.929884:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787862213.930325:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246409728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.931848:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8480:1874709246409856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862213.931948:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.931994:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.932694:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409856 00000100:00100000:0.0:1787862213.932705:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409856 00000100:00100000:0.0:1787862213.932785:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787862213.932796:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8480:x1874709246409856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.933144:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8480:x1874709246409856:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.933153:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787862213.933562:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8480:1874709246409856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862213.933634:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8480:1874709246409984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862213.933695:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.933730:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862213.933834:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246409984 00000100:00100000:0.0:1787862213.933840:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246409984 00000100:00100000:0.0:1787862213.933878:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787862213.933886:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8480:x1874709246409984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.934093:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8480:x1874709246409984:12345-0@lo:502:llog_process_th.0 Request processed in 207us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862213.934100:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787862213.934574:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8480:1874709246409984:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787862213.934601:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787862213.935004:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787862213.935028:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862213.935074:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.935089:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862213.935117:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787862213.935120:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787862213.935124:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862213.935165:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.935174:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.935185:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862213.935207:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.935258:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.935383:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.936353:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410112 00000100:00100000:2.0:1787862213.936366:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410112 00000100:00100000:2.0:1787862213.936445:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787862213.936457:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246410112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862213.936475:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862213.936498:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13b210200/0x391a6cd368cd9b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b6d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.936540:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13b210200/0x391a6cd368cd9b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b6d expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.936556:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13b210200/0x391a6cd368cd9b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b6d expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.936571:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13b210200, rc 0) 00000100:00100000:2.0:1787862213.936649:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246410112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.936658:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787862213.936907:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862213.936932:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.936943:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862213.937022:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.937100:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.937132:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.937239:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410240 00000100:00100000:1.0:1787862213.937244:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410240 00000100:00100000:1.0:1787862213.937295:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787862213.937303:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246410240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862213.937639:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246410240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.937648:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787862213.937948:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.937989:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.938083:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.938110:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.938192:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410368 00000100:00100000:3.0:1787862213.938197:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410368 00000100:00100000:3.0:1787862213.938228:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787862213.938238:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246410368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862213.938443:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246410368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.938452:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787862213.938659:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.939428:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8481:1874709246410496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.939482:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.939515:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d1289c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862213.939853:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410496 00000100:00100000:3.0:1787862213.939860:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410496 00000100:00100000:3.0:1787862213.939903:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787862213.939913:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8481:x1874709246410496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862213.940184:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8481:x1874709246410496:12345-0@lo:502:llog_process_th.0 Request processed in 271us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862213.940193:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787862213.940371:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8481:1874709246410496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862213.940415:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862213.940428:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862213.940431:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787862213.940438:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787862213.940464:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8481:1874709246410624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862213.940504:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.940535:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1192976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.940634:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410624 00000100:00100000:2.0:1787862213.940640:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410624 00000100:00100000:2.0:1787862213.940683:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787862213.940692:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8481:x1874709246410624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862213.940874:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8481:x1874709246410624:12345-0@lo:502:llog_process_th.0 Request processed in 182us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862213.940881:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787862213.941090:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8481:1874709246410624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862213.941113:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862213.941118:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862213.941120:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787862213.941124:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787862213.942278:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787862213.942314:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787862213.942325:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.942350:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862213.942363:0:5865:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787862213.942366:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89a108763490 from 1 10000000:01000000:2.0:1787862213.942369:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787862213.942416:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.942426:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862213.942439:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862213.942461:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.942520:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862213.942557:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862213.942682:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410752 00000100:00100000:1.0:1787862213.942690:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410752 00000100:00100000:1.0:1787862213.942753:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787862213.942764:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246410752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862213.942777:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862213.942795:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9b7b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862213.942822:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9b7b expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862213.942835:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9b7b expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862213.942843:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8800, rc 0) 00000100:00100000:1.0:1787862213.942891:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246410752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862213.942898:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787862213.943111:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862213.943127:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.943138:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862213.943207:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862213.943233:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862213.943255:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1192976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862213.943576:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246410880 00000100:00100000:2.0:1787862213.943581:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246410880 00000100:00100000:2.0:1787862213.943608:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787862213.943616:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246410880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862213.943920:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246410880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (684us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862213.943928:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787862213.944311:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120460000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246410880:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787862213.944354:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787862213.944362:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862213.944373:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862214.152925:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246411008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862214.153012:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862214.155253:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411008 00000100:00100000:2.0:1787862214.155269:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411008 00000100:00100000:2.0:1787862214.155371:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862214.155384:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246411008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862214.155433:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862214.155537:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246411008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862214.155545:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787862214.156414:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35fc00 x1874709246411008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862214.156470:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246411008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862214.789360:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862215.815377:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862216.708738:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862216.708773:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246411136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862216.708864:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862216.708966:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411136 00000100:00100000:2.0:1787862216.708976:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411136 00000100:00100000:2.0:1787862216.709082:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787862216.709083:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862216.709094:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246411136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862216.709136:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862216.709202:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246411136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862216.709211:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787862216.709548:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a70c0 x1874709246411136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862216.709578:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246411136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862216.837532:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862217.555929:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862217.556287:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314048 00000100:00100000:0.0:1787862217.556301:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314048 00000100:00100000:0.0:1787862217.556390:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:0.0:1787862217.556403:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:5598:x1874709223314048:12345-192.168.202.9@tcp:101: 00010000:00010000:0.0:1787862217.556428:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862217.556450:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030200/0x391a6cd368cd9b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c04d7 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862217.556488:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030200/0x391a6cd368cd9b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04d7 expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862217.556527:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030200/0x391a6cd368cd9b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04d7 expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862217.556539:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030200, rc 0) 00000100:00100000:0.0:1787862217.556621:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223314048:12345-192.168.202.9@tcp:101: Request processed in 221us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862217.556630:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:3.0:1787862217.560634:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862217.561556:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314176 00000100:00100000:1.0:1787862217.561571:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314176 00000100:00100000:1.0:1787862217.561793:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:1.0:1787862217.561807:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223314176:12345-192.168.202.9@tcp:501: 00000100:00100000:1.0:1787862217.562216:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223314176:12345-192.168.202.9@tcp:501: Request processed in 410us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862217.562225:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:1.0:1787862217.569311:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862217.569577:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314304 00000100:00100000:3.0:1787862217.569588:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314304 00000100:00100000:3.0:1787862217.569669:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 166 00000100:00100000:3.0:1787862217.569862:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223314304:12345-192.168.202.9@tcp:503: 00000100:00100000:3.0:1787862217.570181:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223314304:12345-192.168.202.9@tcp:503: Request processed in 323us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862217.570200:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 166 00000100:00100000:2.0:1787862217.573881:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862217.579551:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314432 00000100:00100000:1.0:1787862217.579570:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314432 00000100:00100000:1.0:1787862217.579704:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 167 00000100:00100000:1.0:1787862217.579718:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:6090:x1874709223314432:12345-192.168.202.9@tcp:502: 00000100:00100000:1.0:1787862217.580222:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:6090:x1874709223314432:12345-192.168.202.9@tcp:502: Request processed in 504us (6350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862217.580232:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 167 00000100:00100000:0.0:1787862217.586975:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862217.591093:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314560 00000100:00100000:3.0:1787862217.591111:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314560 00000100:00100000:3.0:1787862217.591201:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:3.0:1787862217.591213:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:6090:x1874709223314560:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862217.592689:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:6090:x1874709223314560:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 1457us (5706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862217.592703:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:2.0:1787862217.604107:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862217.604643:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314688 00000100:00100000:0.0:1787862217.604655:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314688 00000100:00100000:0.0:1787862217.604741:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:0.0:1787862217.604754:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223314688:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862217.604778:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862217.604802:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030a00/0x391a6cd368cd9b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c04de expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862217.604839:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030a00/0x391a6cd368cd9b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04de expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862217.604854:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030a00/0x391a6cd368cd9b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04de expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862217.604864:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030a00, rc 0) 00000100:00100000:0.0:1787862217.604940:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223314688:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 187us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862217.604948:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:2.0:1787862217.609633:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862217.609823:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314816 00000100:00100000:3.0:1787862217.609834:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314816 00000100:00100000:3.0:1787862217.609900:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:3.0:1787862217.609912:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223314816:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862217.610569:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223314816:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 655us (943us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862217.610580:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 170 00010000:00010000:2.0:1787862217.861002:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862218.073802:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862218.073912:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862218.073959:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862218.074070:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315200 00000100:00100000:1.0:1787862218.074082:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315200 00000100:00100000:1.0:1787862218.074166:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315072 00000100:00100000:1.0:1787862218.074170:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315072 00000100:00100000:1.0:1787862218.074193:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862218.074205:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223315200:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862218.074294:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223315200:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 91us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862218.074304:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862218.074349:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1787862218.074356:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223315072:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862218.074385:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223315072:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862218.074392:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00080000:3.0:1787862218.074625:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862218.074632:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862218.075198:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223314944 00000100:00100000:0.0:1787862218.075208:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223314944 00000100:00100000:1.0:1787862218.078411:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:1.0:1787862218.078439:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223314944:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862218.078557:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223314944:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 130us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862218.078565:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00080000:3.0:1787862218.080243:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862218.757900:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246411392:0@lo:400:kworker.0 00000100:00100000:2.0:1787862218.757995:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862218.758113:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862218.758119:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246411520:0@lo:400:kworker.0 00000100:00100000:2.0:1787862218.758146:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862218.758222:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246411904:0@lo:400:kworker.0 00000100:00100000:2.0:1787862218.758252:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862218.758491:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246411264:0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.758533:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862218.758566:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246411776:0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.758591:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862218.758610:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862218.758615:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246411648:0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.758638:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862218.758679:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411392 00000100:00100000:0.0:1787862218.758687:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411392 00000100:00100000:0.0:1787862218.758728:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411520 00000100:00100000:0.0:1787862218.758731:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411520 00000100:00100000:0.0:1787862218.758758:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411776 00000100:00100000:0.0:1787862218.758761:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411776 00000100:00100000:0.0:1787862218.758775:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787862218.758784:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246411392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.758858:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246411392:12345-0@lo:400:kworker.0 Request processed in 74us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862218.758867:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787862218.758885:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787862218.758890:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246411520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.758916:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246411520:12345-0@lo:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862218.758921:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787862218.758931:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787862218.758937:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246411776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.758987:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246411776:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862218.758994:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787862218.759015:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862218.759098:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246411520:0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.759116:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246411392:0@lo:400:kworker.0 00000100:00100000:0.0:1787862218.759156:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246411776:0@lo:400:kworker.0 00000100:00100000:1.0:1787862218.759455:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411904 00000100:00100000:1.0:1787862218.759461:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411904 00000100:00100000:1.0:1787862218.759503:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411648 00000100:00100000:1.0:1787862218.759507:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411648 00000100:00100000:1.0:1787862218.759528:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862218.759535:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246411904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862218.759585:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246411904:12345-0@lo:400:kworker.0 Request processed in 50us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862218.759592:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862218.759607:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862218.759612:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120463840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246411648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862218.759646:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120463840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246411648:12345-0@lo:400:kworker.0 Request processed in 34us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862218.759651:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787862218.759705:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35cf00 x1874709246411904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862218.759732:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246411904:0@lo:400:kworker.0 00010000:00080000:1.0:1787862218.759766:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35c000 x1874709246411648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862218.759777:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246411648:0@lo:400:kworker.0 00000100:00100000:2.0:1787862218.759907:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246411264 00000100:00100000:2.0:1787862218.759912:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246411264 00000100:00100000:2.0:1787862218.759955:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787862218.759963:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246411264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862218.760003:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246411264:12345-0@lo:400:kworker.0 Request processed in 42us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862218.760010:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1787862218.760104:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862218.760108:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862218.760283:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246411264:0@lo:400:kworker.0 00010000:00010000:2.0:1787862218.884884:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862219.268696:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862219.268727:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246412032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862219.268806:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862219.268906:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412032 00000100:00100000:0.0:1787862219.268915:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412032 00000100:00100000:0.0:1787862219.268970:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862219.268980:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246412032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862219.269023:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862219.269096:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246412032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862219.269104:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787862219.269149:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c603c0 x1874709246412032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862219.269169:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246412032:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1787862219.671265:0:8519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3d0eac80 20000000:00000080:0.0:1787862219.671294:0:8519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a13d86e400 uarg=0000000000000000 20000000:01000000:0.0:1787862219.671613:0:8519:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787862219.671619:0:8519:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787862219.671625:0:8519:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787862219.673030:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787862219.673464:0:8519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787862219.679102:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787862219.679168:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787862219.679216:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787862219.679235:0:8519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787862219.679260:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679282:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679291:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679299:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679310:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679317:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679355:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.679372:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 9 pid: 5862 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862219.679402:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c603c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412160:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862219.680899:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.680919:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 18 pid: 5862 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862219.680933:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412288:0@lo:104: 00000100:00100000:0.0:1787862219.681003:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862219.681081:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681091:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 18 pid: 5863 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862219.681101:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c612c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412416:0@lo:104: 00000100:00100000:2.0:1787862219.681121:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412288 00000100:00100000:0.0:1787862219.681129:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862219.681132:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412288 00010000:00010000:0.0:1787862219.681154:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681164:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 18 pid: 5860 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862219.681174:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412544:0@lo:104: 00000100:00100000:0.0:1787862219.681195:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108aa6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862219.681213:0:7650:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787862219.681235:0:7650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862219.681246:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412416 00000100:00100000:2.0:1787862219.681249:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412416 00000100:00100000:2.0:1787862219.681266:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412544 00000100:00100000:2.0:1787862219.681268:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412544 00000100:00100000:2.0:1787862219.681282:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862219.681292:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:8519:x1874709246412288:12345-0@lo:104: 00010000:00010000:2.0:1787862219.681308:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.681398:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862219.681405:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:8519:x1874709246412288:12345-0@lo:104: Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862219.681412:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862219.681430:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862219.681438:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d38f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:8519:x1874709246412416:12345-0@lo:104: 00010000:00010000:2.0:1787862219.681446:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.681485:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787862219.681492:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d38f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:8519:x1874709246412416:12345-0@lo:104: Request processed in 55us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862219.681498:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787862219.681510:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412288:0@lo:104: 00000100:00100000:0.0:1787862219.681524:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c612c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412416:0@lo:104: 00000100:00100000:2.0:1787862219.681545:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862219.681553:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:8519:x1874709246412544:12345-0@lo:104: 00010000:00010000:2.0:1787862219.681562:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681573:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862219.681581:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681589:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862219.681593:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.681600:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787862219.681602:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862219.681609:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:8519:x1874709246412544:12345-0@lo:104: Request processed in 56us (372us total) trans 0 rc 0/0 10000000:00010000:0.0:1787862219.681613:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862219.681622:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:0.0:1787862219.681623:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787862219.681645:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862219.681672:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681680:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862219.681708:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681715:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031600/0x391a6cd368cd9a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9a39 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681729:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862219.681731:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681737:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862219.681740:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862219.681751:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246412672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862219.681766:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862219.681774:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862219.681780:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787862219.681790:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862219.681795:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681803:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862219.681811:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862219.681817:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a104c2dc00/0x391a6cd368cd9905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd990c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862219.681830:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787862219.681830:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862219.681832:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862219.681834:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862219.681847:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246412800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862219.681867:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412544:0@lo:104: 00000100:00100000:2.0:1787862219.681879:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862219.681910:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412672 00000100:00100000:0.0:1787862219.681915:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412672 00010000:00010000:0.0:1787862219.681941:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 19 pid: 5862 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862219.681970:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412800 00000100:00100000:0.0:1787862219.681973:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412800 00010000:00010000:0.0:1787862219.681986:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 20 pid: 5860 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862219.682003:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862219.682014:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3327:x1874709246412672:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862219.682016:0:5853:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787862219.682027:0:5853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787862219.682030:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862219.682067:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 20 pid: 5862 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.682079:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 20 pid: 5862 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.682097:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210600/0x391a6cd368cd9a39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9a32 expref: 20 pid: 5862 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.682111:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862219.682148:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246412672:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862219.682155:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862219.682172:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862219.682180:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:3327:x1874709246412800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862219.682189:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862219.682194:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 18 pid: 5860 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862219.682196:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246412672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862219.682211:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 18 pid: 5860 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.682223:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100031a00/0x391a6cd368cd990c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9905 expref: 18 pid: 5860 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862219.682245:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862219.682283:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:3327:x1874709246412800:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862219.682290:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787862219.682333:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246412800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862219.683270:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862219.683275:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862219.683277:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862219.683330:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.683342:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862219.683345:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.683362:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862219.683370:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862219.683423:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862219.683473:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.683480:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787862219.683525:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246412928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862219.683580:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862219.683709:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.683719:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a104c2ce00/0x391a6cd368cd9967 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd996e expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.683745:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862219.683747:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862219.683750:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862219.683779:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246412928 00000100:00100000:1.0:1787862219.683786:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246412928 00010000:00010000:1.0:1787862219.683814:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 17 pid: 5863 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862219.683852:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787862219.683861:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:3329:x1874709246412928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862219.683872:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862219.683877:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 17 pid: 5863 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.683886:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 17 pid: 5863 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.683903:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2c600/0x391a6cd368cd996e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9967 expref: 17 pid: 5863 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.683915:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862219.687986:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3329:x1874709246412928:12345-0@lo:103:ldlm_bl.0 Request processed in 4114us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862219.688002:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862219.689823:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862219.689905:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315328 00000100:00100000:3.0:1787862219.689927:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315328 00010000:00010000:3.0:1787862219.689975:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 10 pid: 5862 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862219.690021:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:3.0:1787862219.690033:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223315328:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862219.690078:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862219.690086:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 10 pid: 5862 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690115:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 10 pid: 5862 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690143:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690152:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690168:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690176:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690184:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690192:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690198:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862219.690202:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690210:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690220:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862219.690242:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862219.690315:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223315328:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 283us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862219.690323:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00010000:00010000:1.0:1787862219.691476:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030e00/0x391a6cd368cd9af6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04a6 expref: 9 pid: 5862 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862219.691496:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c603c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874709246412160:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862219.691533:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246412928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862219.691540:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.691553:0:8519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.691559:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.691566:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030c00/0x391a6cd368cd9b97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862219.910079:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862220.932509:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862221.076650:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862221.076783:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315456 00000100:00100000:2.0:1787862221.076796:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315456 00000100:00100000:2.0:1787862221.076858:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:2.0:1787862221.076871:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:5598:x1874709223315456:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862221.076902:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862221.076928:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c04e5 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.076961:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.076974:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.076984:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79fe00, rc 0) 00000100:00100000:2.0:1787862221.077092:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223315456:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 223us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.077100:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:2.0:1787862221.081179:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862221.081313:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315584 00000100:00100000:1.0:1787862221.081324:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315584 00000100:00100000:1.0:1787862221.081376:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:1.0:1787862221.081387:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223315584:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.081729:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223315584:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 342us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862221.081738:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:3.0:1787862221.087358:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862221.088009:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315712 00000100:00100000:0.0:1787862221.088022:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315712 00000100:00100000:0.0:1787862221.088100:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:0.0:1787862221.088112:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223315712:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862221.088394:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:5598:x1874709223315712:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 283us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862221.088403:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:3.0:1787862221.098393:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862221.099066:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315840 00000100:00100000:1.0:1787862221.099078:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315840 00000100:00100000:1.0:1787862221.099137:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:1.0:1787862221.099147:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:6148:x1874709223315840:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862221.099435:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:6148:x1874709223315840:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 288us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862221.099448:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:0.0:1787862221.112113:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862221.112196:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223315968 00000100:00100000:3.0:1787862221.112207:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223315968 00000100:00100000:3.0:1787862221.112279:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 176 00000100:00100000:3.0:1787862221.112290:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:6148:x1874709223315968:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862221.112589:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:6148:x1874709223315968:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 298us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862221.112597:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 176 10000000:01000000:1.0:1787862221.572182:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862221.572191:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102aa4000 from 4 10000000:01000000:1.0:1787862221.572196:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862221.572249:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.572262:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.572275:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862221.572318:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.572411:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862221.572469:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862221.572655:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413056 00000100:00100000:0.0:1787862221.572663:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413056 00000100:00100000:0.0:1787862221.572729:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787862221.572738:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246413056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862221.572753:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862221.572769:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9ba5 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.572795:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.572807:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.572836:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031a00, rc 0) 00000100:00100000:0.0:1787862221.572882:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246413056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862221.572890:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787862221.573131:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862221.573147:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.573157:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862221.573221:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.573251:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862221.573298:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.573399:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413184 00000100:00100000:2.0:1787862221.573404:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413184 00000100:00100000:2.0:1787862221.573442:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862221.573449:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246413184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.573784:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246413184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.573792:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862221.573827:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.573859:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.573899:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862221.573914:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.573927:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413312 00000100:00100000:2.0:1787862221.573931:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413312 00000100:00100000:2.0:1787862221.573952:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787862221.573958:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246413312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.574143:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246413312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.574150:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787862221.574186:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.578618:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8571:1874709246413440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862221.578763:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862221.578812:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.578933:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413440 00000100:00100000:2.0:1787862221.578942:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413440 00000100:00100000:2.0:1787862221.579016:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787862221.579026:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8571:x1874709246413440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862221.579299:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8571:x1874709246413440:12345-0@lo:502:llog_process_th.0 Request processed in 274us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.579308:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787862221.579652:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8571:1874709246413440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862221.579686:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862221.579697:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862221.579701:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787862221.579709:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a102aa4000 00000020:00000080:1.0:1787862221.579712:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787862221.584386:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8571:1874709246413568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862221.584492:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.584536:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862221.586467:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413568 00000100:00100000:0.0:1787862221.586479:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413568 00000100:00100000:0.0:1787862221.586547:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787862221.586557:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8571:x1874709246413568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862221.586850:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:8571:x1874709246413568:12345-0@lo:502:llog_process_th.0 Request processed in 293us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862221.586858:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787862221.590954:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8571:1874709246413568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862221.591014:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862221.591131:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862221.591134:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787862221.591141:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787862221.594222:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787862221.594262:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862221.594277:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594303:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862221.594315:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862221.594318:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a1102e9000 from 4 10000000:01000000:2.0:1787862221.594320:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862221.594362:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594370:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594381:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862221.594410:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.594486:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862221.594527:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.594549:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413696 00000100:00100000:2.0:1787862221.594574:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413696 00000100:00100000:2.0:1787862221.594618:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787862221.594626:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246413696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862221.594651:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862221.594665:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9bb3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594691:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594702:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594711:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e000, rc 0) 00000100:00100000:2.0:1787862221.594762:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246413696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.594770:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787862221.594819:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862221.594834:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862221.594844:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862221.594896:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.594921:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862221.594934:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.594946:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413824 00000100:00100000:2.0:1787862221.594956:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413824 00000100:00100000:2.0:1787862221.594979:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787862221.594985:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246413824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.595511:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246413824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 522us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.595520:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787862221.595556:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.595584:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.595620:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862221.595650:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.595661:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246413952 00000100:00100000:2.0:1787862221.595664:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246413952 00000100:00100000:2.0:1787862221.595683:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787862221.595689:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246413952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862221.596525:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246413952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 830us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.596534:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787862221.596588:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246413952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862221.611942:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8573:1874709246414080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862221.612033:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.612102:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.612122:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414080 00000100:00100000:2.0:1787862221.612130:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414080 00000100:00100000:2.0:1787862221.612188:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787862221.612198:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8573:x1874709246414080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862221.613697:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8573:1874709246414080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862221.613750:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862221.613761:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862221.613764:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787862221.613772:0:8573:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a1102e9000 00000020:00000080:1.0:1787862221.613776:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787862221.613844:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8573:x1874709246414080:12345-0@lo:502:llog_process_th.0 Request processed in 1646us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.613855:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787862221.614104:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8573:1874709246414208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862221.630160:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.630235:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862221.632261:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414208 00000100:00100000:0.0:1787862221.632274:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414208 00000100:00100000:0.0:1787862221.632358:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787862221.632370:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8573:x1874709246414208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862221.632649:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:8573:x1874709246414208:12345-0@lo:502:llog_process_th.0 Request processed in 268us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862221.632658:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787862221.632688:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8573:1874709246414208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862221.632733:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862221.632742:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862221.632744:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787862221.632750:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787862221.634946:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787862221.634982:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862221.634995:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.635008:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862221.635020:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862221.635034:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102b43800 from 4 10000000:01000000:0.0:1787862221.635053:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862221.635094:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.635102:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.635111:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862221.635136:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246414336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862221.635196:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.635252:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b9706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862221.635451:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414336 00000100:00100000:1.0:1787862221.635458:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414336 00000100:00100000:1.0:1787862221.635508:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787862221.635518:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246414336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862221.635531:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862221.635544:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9bc1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.635568:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.635586:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.635595:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8400, rc 0) 00000100:00100000:1.0:1787862221.635633:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246414336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862221.635652:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787862221.638205:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246414336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862221.638234:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862221.638246:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862221.638385:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246414464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862221.638445:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.638488:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b9706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862221.638681:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414464 00000100:00100000:1.0:1787862221.638687:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414464 00000100:00100000:1.0:1787862221.638733:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787862221.638742:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246414464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.639068:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246414464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862221.639076:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787862221.639144:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246414464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862221.639178:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246414592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862221.639218:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.639240:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b9706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862221.639731:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414592 00000100:00100000:1.0:1787862221.639737:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414592 00000100:00100000:1.0:1787862221.639767:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787862221.639774:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246414592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.640210:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246414592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 434us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862221.640218:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787862221.643180:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246414592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862221.644088:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8576:1874709246414720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862221.644185:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862221.644243:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d6df3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862221.644588:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414720 00000100:00100000:3.0:1787862221.644595:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414720 00000100:00100000:3.0:1787862221.644657:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787862221.644675:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:8576:x1874709246414720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862221.644924:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:8576:x1874709246414720:12345-0@lo:502:llog_process_th.0 Request processed in 257us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862221.644932:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787862221.646329:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8576:1874709246414720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862221.646382:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862221.646395:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862221.646398:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787862221.646405:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a102b43800 00000020:00000080:1.0:1787862221.646408:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787862221.646777:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8576:1874709246414848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862221.646838:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862221.646869:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d6df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862221.650384:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414848 00000100:00100000:2.0:1787862221.650398:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414848 00000100:00100000:2.0:1787862221.650465:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787862221.650474:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:8576:x1874709246414848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862221.650769:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:8576:x1874709246414848:12345-0@lo:502:llog_process_th.0 Request processed in 296us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862221.650777:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787862221.658187:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:8576:1874709246414848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862221.658243:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862221.658252:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862221.658255:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787862221.658261:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787862221.661147:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787862221.661180:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862221.661191:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862221.661204:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862221.832178:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862221.832205:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246414976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862221.832292:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862221.840554:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246414976 00000100:00100000:0.0:1787862221.840574:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246414976 00000100:00100000:0.0:1787862221.842918:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862221.842934:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246414976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862221.849430:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862221.849522:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246414976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6589us (17227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862221.849541:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787862221.849627:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862221.849681:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a5e00 x1874709246414976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862221.849710:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246414976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862221.956223:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862222.984996:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862223.188196:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862223.188248:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862223.188447:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316096 00000100:00100000:1.0:1787862223.188468:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316096 00000100:00100000:3.0:1787862223.188539:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862223.188551:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:1.0:1787862223.188564:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223316096:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862223.188731:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316224 00000100:00100000:2.0:1787862223.188737:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316224 00000100:00100000:2.0:1787862223.188791:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:2.0:1787862223.188801:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223316224:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862223.188869:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223316096:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 307us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862223.188879:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:3.0:1787862223.189016:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00080000:3.0:1787862223.190977:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862223.197014:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316352 00000100:00100000:1.0:1787862223.197033:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316352 00000100:00100000:1.0:1787862223.197384:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316480 00000100:00100000:1.0:1787862223.197408:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316480 00000100:00100000:1.0:1787862223.197439:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1787862223.197450:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223316352:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862223.197666:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223316352:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 217us (9415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862223.197676:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1787862223.197700:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:1.0:1787862223.197709:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223316480:12345-192.168.202.9@tcp:400:kworker.0 00000100:00080000:3.0:1787862223.197792:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862223.197798:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862223.197848:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223316224:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 9048us (9318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862223.197858:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:1.0:1787862223.202466:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223316480:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 4743us (13437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862223.202482:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1787862223.881481:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246415488:0@lo:400:kworker.0 00000100:00100000:2.0:1787862223.881601:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862223.881886:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246415104:0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.881931:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862223.881963:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246415360:0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.881992:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862223.882128:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415104 00000100:00100000:2.0:1787862223.882138:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415104 00000100:00100000:2.0:1787862223.882196:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787862223.882207:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246415104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862223.882267:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246415104:12345-0@lo:400:kworker.0 Request processed in 61us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862223.882276:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787862223.882409:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415360 00000100:00100000:1.0:1787862223.882414:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415360 00000100:00100000:1.0:1787862223.882480:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787862223.882489:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246415360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862223.882536:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246415360:12345-0@lo:400:kworker.0 Request processed in 48us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862223.882543:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787862223.882627:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862223.882715:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246415232:0@lo:400:kworker.0 00000100:00100000:3.0:1787862223.882964:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862223.886977:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415488 00000100:00100000:0.0:1787862223.887000:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415488 00000100:00080000:0.0:1787862223.887094:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862223.887196:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787862223.887210:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246415488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.890147:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246415488:12345-0@lo:400:kworker.0 Request processed in 2925us (8530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862223.890166:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787862223.891928:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246415104:0@lo:400:kworker.0 00000100:00100000:1.0:1787862223.891948:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246415616:0@lo:400:kworker.0 00000100:00100000:1.0:1787862223.892061:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787862223.892169:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35f0c0 x1874709246415488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862223.892184:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246415488:0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.892272:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415232 00000100:00100000:0.0:1787862223.892280:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415232 00000100:00100000:0.0:1787862223.892325:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415616 00000100:00100000:0.0:1787862223.892327:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415616 00000100:00100000:0.0:1787862223.892373:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862223.892382:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246415232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.892451:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246415232:12345-0@lo:400:kworker.0 Request processed in 69us (9495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862223.892458:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862223.892475:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787862223.892480:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246415616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.892503:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246415616:12345-0@lo:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862223.892508:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787862223.894950:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862223.897559:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246415360:0@lo:400:kworker.0 00000100:00100000:3.0:1787862223.899116:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246415232:0@lo:400:kworker.0 00000100:00100000:3.0:1787862223.899144:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246415744:0@lo:400:kworker.0 00000100:00100000:3.0:1787862223.899395:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862223.899560:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415744 00000100:00100000:0.0:1787862223.899567:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415744 00000100:00100000:0.0:1787862223.899726:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862223.899736:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246415744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862223.899794:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246415744:12345-0@lo:400:kworker.0 Request processed in 59us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862223.899801:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787862223.899890:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787862223.899979:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35f480 x1874709246415744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862223.900379:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246415744:0@lo:400:kworker.0 00000100:00100000:1.0:1787862223.901810:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246415616:0@lo:400:kworker.0 00010000:00010000:2.0:1787862224.004421:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862224.388523:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862224.388544:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246415872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862224.388637:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862224.388704:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246415872 00000100:00100000:2.0:1787862224.388712:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246415872 00000100:00100000:2.0:1787862224.388761:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862224.388770:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246415872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862224.388812:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862224.388856:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246415872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862224.388865:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787862224.388910:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35e1c0 x1874709246415872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862224.388931:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246415872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862225.029717:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862226.054167:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862226.948602:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246416000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862226.948869:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862226.949344:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416000 00000100:00100000:2.0:1787862226.949353:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416000 00000100:00100000:2.0:1787862226.949411:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862226.949422:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246416000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862226.949457:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862226.949512:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246416000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862226.949521:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787862226.949543:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862226.955928:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c630c0 x1874709246416000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862226.955963:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246416000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862227.083198:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862228.100597:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862228.321246:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862228.321366:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316608 00000100:00100000:1.0:1787862228.321379:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316608 00000100:00100000:1.0:1787862228.321455:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:1.0:1787862228.321466:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223316608:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862228.321552:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223316608:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862228.321560:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:3.0:1787862228.340735:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862228.341653:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316736 00000100:00100000:0.0:1787862228.341674:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316736 00000100:00100000:0.0:1787862228.341791:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1787862228.341801:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223316736:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862228.341886:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223316736:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 86us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862228.341893:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00080000:3.0:1787862228.341992:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862228.344642:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862228.344672:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862228.344702:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316864 00000100:00100000:3.0:1787862228.344709:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316864 00000100:00100000:3.0:1787862228.344752:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223316992 00000100:00100000:3.0:1787862228.344754:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223316992 00000100:00100000:3.0:1787862228.344767:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862228.344781:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2351:x1874709223316864:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1787862228.344814:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9b04 00000100:00080000:3.0:1787862228.344822:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a102aa6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787862228.344858:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787862228.345282:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+2:2351:x1874709223316864:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 500us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862228.345290:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862228.345304:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1787862228.345311:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2351:x1874709223316992:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1787862228.345324:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9b0b 00000100:00080000:3.0:1787862228.345329:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a11ee68000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787862228.345346:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787862228.345505:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+2:2351:x1874709223316992:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 194us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862228.345510:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00010000:00010000:3.0:1787862228.345572:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862228.345592:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787862228.345599:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862228.345603:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787862228.499752:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1787862228.997905:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246416384:0@lo:400:kworker.0 00000100:00100000:0.0:1787862228.998015:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862228.998117:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862228.998124:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246416512:0@lo:400:kworker.0 00000100:00100000:0.0:1787862228.998151:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862228.998196:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416512 00000100:00100000:0.0:1787862228.998205:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416512 00000100:00100000:0.0:1787862228.998270:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787862228.998282:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246416512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862228.998347:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246416512:12345-0@lo:400:kworker.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862228.998355:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787862228.998395:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c62580 x1874709246416512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862228.998409:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246416512:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.000659:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246416128:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.000724:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862229.000777:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246416640:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.000807:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862229.000834:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787862229.000839:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246416256:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.000856:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862229.000868:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246416768:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.000881:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862229.000906:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416128 00000100:00100000:1.0:1787862229.000912:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416128 00000100:00100000:1.0:1787862229.000954:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787862229.000963:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001012:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246416128:12345-0@lo:400:kworker.0 Request processed in 50us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862229.001018:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787862229.001072:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416384 00000100:00100000:1.0:1787862229.001075:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416384 00000100:00100000:1.0:1787862229.001096:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416640 00000100:00100000:1.0:1787862229.001097:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416640 00000100:00100000:1.0:1787862229.001113:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416256 00000100:00100000:1.0:1787862229.001114:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416256 00000100:00100000:1.0:1787862229.001122:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787862229.001126:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246416384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001156:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246416384:12345-0@lo:400:kworker.0 Request processed in 30us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862229.001161:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787862229.001168:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787862229.001171:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246416640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001186:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246416640:12345-0@lo:400:kworker.0 Request processed in 15us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862229.001190:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787862229.001195:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862229.001199:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246416256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001221:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246416256:12345-0@lo:400:kworker.0 Request processed in 21us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862229.001226:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862229.001271:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246416384:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001294:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246416256:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001299:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246416128:0@lo:400:kworker.0 00000100:00100000:1.0:1787862229.001304:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246416640:0@lo:400:kworker.0 00000100:00080000:3.0:1787862229.001491:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862229.001498:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862229.001510:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416768 00000100:00100000:3.0:1787862229.001513:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416768 00000100:00100000:3.0:1787862229.001563:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787862229.001581:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246416768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862229.001625:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246416768:12345-0@lo:400:kworker.0 Request processed in 46us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862229.001640:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787862229.001668:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c63840 x1874709246416768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862229.001677:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246416768:0@lo:400:kworker.0 00000100:00080000:1.0:1787862229.001723:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787862229.124409:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862229.521389:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246416896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862229.521498:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862229.521718:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246416896 00000100:00100000:2.0:1787862229.521729:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246416896 00000100:00100000:2.0:1787862229.521799:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862229.521823:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246416896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862229.521877:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862229.521944:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246416896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (445us total) trans 0 rc 0/0 00010000:00080000:0.0:1787862229.522093:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c62580 x1874709246416896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862229.522130:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246416896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862229.522191:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787862230.148249:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862231.181244:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862232.079813:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246417024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862232.079927:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862232.080089:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417024 00000100:00100000:2.0:1787862232.080098:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417024 00000100:00100000:2.0:1787862232.080168:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862232.080180:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246417024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862232.080230:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862232.080285:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246417024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862232.080292:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787862232.080503:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35d2c0 x1874709246417024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862232.080527:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246417024:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787862232.081225:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862232.198724:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787862232.241857:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:3.0:1787862232.241873:0:6736:0:(genops.c:885:class_export_put()) final put ffff89a102aa3800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:0.0:1787862232.242120:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102aa3800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 for lustre-OST0000 00000020:00000080:0.0:1787862232.242177:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a102aa6000 for lustre-OST0000 00000001:00100000:1.0:1787862233.207417:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:1.0:1787862233.207432:0:7661:0:(genops.c:885:class_export_put()) final put ffff89a11ee6d000/c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:1.0:1787862233.207479:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a11ee6d000/c20d7abe-3b31-4da4-909a-c5bb95bfc247 for lustre-OST0001 00000020:00000080:1.0:1787862233.207543:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a11ee68000 for lustre-OST0001 00010000:00010000:3.0:1787862233.220340:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862233.457115:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862233.457308:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862233.457354:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317248 00000100:00100000:3.0:1787862233.457369:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317248 00000100:00100000:3.0:1787862233.457466:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:3.0:1787862233.457480:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223317248:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862233.457618:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223317248:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 139us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862233.457627:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00080000:3.0:1787862233.457659:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862233.461231:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317120 00000100:00100000:0.0:1787862233.461254:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317120 00000100:00100000:0.0:1787862233.461368:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:0.0:1787862233.461381:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223317120:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862233.461498:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223317120:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 119us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862233.461507:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:1.0:1787862234.116562:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246417280:0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.116687:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862234.116762:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246417792:0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.116795:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862234.116837:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787862234.116844:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246417152:0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.116877:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862234.116901:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246417664:0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.116924:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862234.116961:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417792 00000100:00100000:1.0:1787862234.116971:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417792 00000100:00100000:1.0:1787862234.117094:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862234.117107:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246417792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.117176:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246417792:12345-0@lo:400:kworker.0 Request processed in 71us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862234.117185:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862234.117215:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417152 00000100:00100000:1.0:1787862234.117219:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417152 00000100:00100000:1.0:1787862234.117248:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787862234.117255:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246417152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.117286:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246417152:12345-0@lo:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862234.117294:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787862234.117326:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417280 00000100:00100000:1.0:1787862234.117339:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417280 00000100:00100000:1.0:1787862234.117369:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417664 00000100:00100000:1.0:1787862234.117372:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417664 00000100:00100000:1.0:1787862234.117389:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862234.117396:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246417280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.117428:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246417280:12345-0@lo:400:kworker.0 Request processed in 33us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862234.117435:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862234.117447:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862234.117454:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246417664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.117481:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246417664:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862234.117487:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787862234.117506:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862234.117512:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862234.117569:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246417152:0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.117585:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246417664:0@lo:400:kworker.0 00000100:00100000:1.0:1787862234.117596:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246417280:0@lo:400:kworker.0 00010000:00080000:1.0:1787862234.117610:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c52d00 x1874709246417792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862234.117622:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246417792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862234.117873:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246417408:0@lo:400:kworker.0 00000100:00100000:2.0:1787862234.117914:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862234.117951:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862234.117958:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246417536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862234.117985:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862234.118037:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417408 00000100:00100000:2.0:1787862234.118094:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417408 00000100:00100000:2.0:1787862234.118140:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862234.118147:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246417408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862234.118193:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246417408:12345-0@lo:400:kworker.0 Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862234.118200:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862234.118223:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417536 00000100:00100000:2.0:1787862234.118227:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417536 00000100:00100000:2.0:1787862234.118255:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862234.118262:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246417536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862234.118293:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246417536:12345-0@lo:400:kworker.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862234.118299:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787862234.118317:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862234.118320:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787862234.118339:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4780 x1874709246417536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862234.118352:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246417536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862234.118363:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246417408:0@lo:400:kworker.0 00010000:00010000:0.0:1787862234.244865:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862234.630457:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246417920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862234.634405:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862234.643071:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246417920 00000100:00100000:1.0:1787862234.643095:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246417920 00000100:00100000:1.0:1787862234.643347:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787862234.643370:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246417920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862234.643426:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862234.643552:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246417920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (9329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862234.643561:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787862234.644497:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c52d00 x1874709246417920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862234.644540:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246417920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862235.279025:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862235.571551:0:9066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing yml_node 00010000:00010000:3.0:1787862236.292394:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862237.197339:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246418048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862237.197452:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862237.198338:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418048 00000100:00100000:1.0:1787862237.198352:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418048 00000100:00100000:1.0:1787862237.199409:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787862237.199431:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246418048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862237.199488:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862237.199617:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246418048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862237.199625:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787862237.199662:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787862237.199720:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35f0c0 x1874709246418048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862237.199752:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246418048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862237.320423:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862238.340743:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862238.557023:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862238.557137:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862238.557628:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317504 00000100:00100000:2.0:1787862238.557643:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317504 00000100:00100000:2.0:1787862238.557765:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1787862238.557780:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223317504:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862238.557906:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223317504:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 130us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862238.557916:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00080000:3.0:1787862238.558070:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862238.559343:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317376 00000100:00100000:1.0:1787862238.559374:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317376 00000100:00100000:1.0:1787862238.559469:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 198 00000100:00100000:1.0:1787862238.559494:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223317376:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862238.559619:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223317376:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 139us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862238.559646:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 198 00000100:00100000:2.0:1787862239.236720:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246418176:0@lo:400:kworker.0 00000100:00100000:2.0:1787862239.236827:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862239.236994:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246418304:0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.237035:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862239.237867:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418176 00000100:00100000:1.0:1787862239.237881:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418176 00000100:00100000:1.0:1787862239.237967:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787862239.237978:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246418176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.238149:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418304 00000100:00100000:0.0:1787862239.238156:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418304 00000100:00100000:0.0:1787862239.238195:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862239.238203:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246418304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.238279:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246418304:12345-0@lo:400:kworker.0 Request processed in 76us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862239.238287:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862239.238351:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246418304:0@lo:400:kworker.0 00000100:00100000:3.0:1787862239.242203:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246418560:0@lo:400:kworker.0 00000100:00100000:3.0:1787862239.242311:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862239.242838:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246418176:12345-0@lo:400:kworker.0 Request processed in 4858us (6007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862239.242855:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787862239.242907:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246418432:0@lo:400:kworker.0 00000100:00100000:1.0:1787862239.242975:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862239.243110:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1204bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246418816:0@lo:400:kworker.0 00000100:00100000:3.0:1787862239.249616:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862239.249693:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862239.249714:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246418688:0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.250801:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418432 00000100:00100000:0.0:1787862239.250820:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418432 00000100:00100000:0.0:1787862239.250906:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862239.250921:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246418432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862239.251189:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418560 00000100:00100000:3.0:1787862239.251195:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418560 00000100:00100000:3.0:1787862239.251242:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418816 00000100:00100000:3.0:1787862239.251246:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418816 00000100:00100000:3.0:1787862239.251265:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787862239.251273:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246418560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862239.252330:0:6712:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787862239.252362:0:6712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1787862239.252432:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862239.252438:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862239.252444:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862239.256593:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246418432:12345-0@lo:400:kworker.0 Request processed in 5657us (13598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862239.256615:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862239.256724:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246418432:0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.256832:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862239.256851:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246418816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.256928:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246418816:12345-0@lo:400:kworker.0 Request processed in 86us (7326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862239.256935:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862239.273034:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246418560:12345-0@lo:400:kworker.0 Request processed in 21738us (30699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862239.273082:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787862239.273365:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a00838bc00 x1874709246418560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862239.273390:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246418560:0@lo:400:kworker.0 00000100:00100000:1.0:1787862239.278654:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787862239.278762:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1204bbc00 x1874709246418816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862239.278783:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1204bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246418816:0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.279303:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418688 00000100:00100000:0.0:1787862239.279325:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418688 00000100:00100000:0.0:1787862239.279436:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862239.279450:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246418688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862239.279600:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246418688:12345-0@lo:400:kworker.0 Request processed in 152us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862239.279609:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787862239.281212:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862239.281325:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246418688:0@lo:400:kworker.0 00000100:00100000:2.0:1787862239.285160:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246418176:0@lo:400:kworker.0 00010000:00010000:3.0:1787862239.367130:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862239.750553:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246418944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862239.750673:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862239.751082:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246418944 00000100:00100000:1.0:1787862239.751093:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246418944 00000100:00100000:1.0:1787862239.751179:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862239.751191:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246418944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862239.751268:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862239.751357:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246418944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862239.751366:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787862239.752915:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c503c0 x1874709246418944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862239.752973:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246418944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862240.388758:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862241.423492:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862241.635459:0:9260:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.120 00000100:00100000:2.0:1787862242.313977:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862242.314010:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246419072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862242.314159:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862242.314258:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419072 00000100:00100000:2.0:1787862242.314279:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419072 00000100:00100000:2.0:1787862242.314350:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862242.314361:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246419072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862242.314406:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862242.314468:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246419072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862242.314475:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787862242.314498:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862242.314885:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35ed00 x1874709246419072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862242.314912:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246419072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862242.437905:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862243.461752:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862243.680170:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862243.680234:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862243.680560:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317760 00000100:00100000:0.0:1787862243.680574:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317760 00000100:00100000:0.0:1787862243.680687:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:0.0:1787862243.680701:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223317760:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862243.680821:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223317760:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 124us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862243.680829:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00080000:1.0:1787862243.680932:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862243.681302:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317632 00000100:00100000:2.0:1787862243.681310:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317632 00000100:00100000:2.0:1787862243.681362:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:2.0:1787862243.681370:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223317632:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862243.681420:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223317632:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 49us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862243.681457:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:1.0:1787862244.356662:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246419456:0@lo:400:kworker.0 00000100:00100000:1.0:1787862244.356798:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862244.356899:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862244.356906:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246419584:0@lo:400:kworker.0 00000100:00100000:1.0:1787862244.356940:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862244.357003:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419456 00000100:00100000:1.0:1787862244.357016:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419456 00000100:00100000:3.0:1787862244.357236:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246419200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357287:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862244.357316:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246419712:0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357342:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862244.357363:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787862244.357369:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246419328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357395:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862244.357413:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246419840:0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357448:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862244.357481:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419200 00000100:00100000:3.0:1787862244.357486:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419200 00000100:00100000:3.0:1787862244.357556:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787862244.357567:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246419200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357632:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246419200:12345-0@lo:400:kworker.0 Request processed in 66us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862244.357641:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787862244.357680:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419712 00000100:00100000:3.0:1787862244.357683:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419712 00000100:00100000:3.0:1787862244.357707:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419328 00000100:00100000:3.0:1787862244.357710:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419328 00000100:00100000:3.0:1787862244.357723:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787862244.357729:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246419712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357761:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246419712:12345-0@lo:400:kworker.0 Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862244.357767:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787862244.357779:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787862244.357784:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246419328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357809:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246419328:12345-0@lo:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862244.357815:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787862244.357866:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246419328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357875:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246419200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862244.357884:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246419712:0@lo:400:kworker.0 00000100:00100000:1.0:1787862244.358118:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862244.358129:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246419456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862244.358183:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246419456:12345-0@lo:400:kworker.0 Request processed in 55us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862244.358190:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787862244.358355:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862244.358392:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246419456:0@lo:400:kworker.0 00000100:00100000:0.0:1787862244.358842:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419584 00000100:00100000:0.0:1787862244.358851:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419584 00000100:00100000:0.0:1787862244.358926:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419840 00000100:00100000:0.0:1787862244.358929:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419840 00000100:00100000:0.0:1787862244.358954:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862244.358962:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246419584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862244.359066:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246419584:12345-0@lo:400:kworker.0 Request processed in 104us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862244.359083:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862244.359104:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862244.359127:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862244.359168:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246419840:12345-0@lo:400:kworker.0 Request processed in 42us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862244.359174:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787862244.359520:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c51e00 x1874709246419840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862244.359539:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246419840:0@lo:400:kworker.0 00010000:00080000:0.0:1787862244.359591:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c50780 x1874709246419584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862244.359603:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246419584:0@lo:400:kworker.0 00000100:00080000:1.0:1787862244.359884:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862244.359890:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862244.488876:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862244.868227:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246419968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862244.868345:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862244.875341:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246419968 00000100:00100000:2.0:1787862244.875364:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246419968 00000100:00100000:2.0:1787862244.875467:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862244.875481:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246419968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862244.875538:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862244.875679:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246419968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (7334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862244.875688:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787862244.875837:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c60b40 x1874709246419968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862244.875864:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246419968:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787862244.920777:0:9359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.120 00010000:00010000:0.0:1787862245.508458:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862246.544388:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862247.428534:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862247.428581:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246420096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862247.428692:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862247.428817:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420096 00000100:00100000:3.0:1787862247.428828:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420096 00000100:00100000:3.0:1787862247.428920:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862247.428930:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108673c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246420096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862247.428976:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862247.429029:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108673c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246420096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862247.429037:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787862247.429115:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862247.429154:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086730c0 x1874709246420096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862247.429177:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246420096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862247.561522:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787862248.301815:0:9456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.120 00010000:00010000:1.0:1787862248.602524:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862248.793320:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862248.793375:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862248.793424:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223317888 00000100:00100000:2.0:1787862248.793436:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223317888 00000100:00100000:2.0:1787862248.793499:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:2.0:1787862248.793510:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223317888:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862248.793600:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223317888:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862248.793609:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:2.0:1787862248.796160:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318016 00000100:00100000:2.0:1787862248.796179:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318016 00000100:00100000:2.0:1787862248.796291:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:2.0:1787862248.796306:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223318016:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862248.796428:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223318016:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 125us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862248.796457:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00080000:3.0:1787862248.804478:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862249.481270:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108671e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246420608:0@lo:400:kworker.0 00000100:00100000:3.0:1787862249.481387:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862249.481476:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862249.481483:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246420480:0@lo:400:kworker.0 00000100:00100000:3.0:1787862249.481516:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862249.481554:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420480 00000100:00100000:3.0:1787862249.481565:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420480 00000100:00100000:3.0:1787862249.481648:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787862249.481660:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246420480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862249.481727:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246420480:12345-0@lo:400:kworker.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862249.481975:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246420352:0@lo:400:kworker.0 00000100:00100000:1.0:1787862249.482014:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862249.482065:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246420864:0@lo:400:kworker.0 00000100:00100000:1.0:1787862249.482088:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862249.482113:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787862249.482117:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246420224:0@lo:400:kworker.0 00000100:00100000:1.0:1787862249.482146:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862249.482168:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108670b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246420736:0@lo:400:kworker.0 00000100:00100000:1.0:1787862249.482190:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862249.482211:0:5869:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787862249.482220:0:5869:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787862249.482236:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420224 00000100:00100000:1.0:1787862249.482252:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420224 00000100:00100000:1.0:1787862249.482289:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787862249.482296:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246420224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862249.482333:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246420224:12345-0@lo:400:kworker.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862249.482341:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787862249.482506:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246420224:0@lo:400:kworker.0 00000100:00100000:1.0:1787862249.482547:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420352 00000100:00100000:1.0:1787862249.482550:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420352 00000100:00100000:3.0:1787862249.482618:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787862249.482639:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420736 00000100:00100000:3.0:1787862249.482659:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420736 00000100:00100000:0.0:1787862249.482766:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420608 00000100:00100000:0.0:1787862249.482770:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420608 00000100:00100000:0.0:1787862249.482805:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420864 00000100:00100000:0.0:1787862249.482809:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420864 00000100:00100000:0.0:1787862249.482831:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862249.482839:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108671a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246420608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862249.482890:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108671a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246420608:12345-0@lo:400:kworker.0 Request processed in 52us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862249.482896:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862249.482909:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787862249.482914:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246420864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862249.482959:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246420864:12345-0@lo:400:kworker.0 Request processed in 44us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862249.482965:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787862249.483010:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086712c0 x1874709246420864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862249.483024:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246420864:0@lo:400:kworker.0 00000100:00080000:2.0:1787862249.483784:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862249.483791:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862249.483794:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862249.483837:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246420480:0@lo:400:kworker.0 00010000:00080000:2.0:1787862249.483856:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108671e00 x1874709246420608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862249.483867:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108671e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246420608:0@lo:400:kworker.0 00000100:00100000:0.0:1787862249.489088:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787862249.489114:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246420352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862249.489272:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246420352:12345-0@lo:400:kworker.0 Request processed in 168us (7256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862249.489293:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787862249.489367:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246420352:0@lo:400:kworker.0 00000100:00100000:3.0:1787862249.489762:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787862249.489776:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246420736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862249.489828:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246420736:12345-0@lo:400:kworker.0 Request processed in 57us (7636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862249.489835:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787862249.489878:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108670b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246420736:0@lo:400:kworker.0 00010000:00010000:0.0:1787862249.605714:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862249.988248:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862249.988283:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246420992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862249.988397:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862249.988486:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246420992 00000100:00100000:1.0:1787862249.988498:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246420992 00000100:00100000:1.0:1787862249.988568:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787862249.988587:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246420992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862249.988805:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862249.988870:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246420992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 283us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862249.988879:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787862249.988931:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c51e00 x1874709246420992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862249.989145:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246420992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862250.628245:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862251.059736:0:9506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 16:24:08 EDT 2026 00010000:00010000:1.0:1787862251.652460:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862252.552550:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246421120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862252.552651:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862252.552757:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421120 00000100:00100000:0.0:1787862252.552767:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421120 00000100:00100000:0.0:1787862252.552845:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862252.552856:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246421120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862252.552905:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862252.552964:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246421120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862252.552972:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787862252.552996:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862252.553029:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c62d00 x1874709246421120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862252.553080:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246421120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862252.676524:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862253.701187:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862253.920082:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862253.920125:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862253.920154:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318272 00000100:00100000:1.0:1787862253.920164:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318272 00000100:00100000:1.0:1787862253.920232:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:1.0:1787862253.920241:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223318272:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862253.920315:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223318272:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862253.920323:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:1.0:1787862253.920361:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318144 00000100:00100000:1.0:1787862253.920364:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318144 00000100:00100000:1.0:1787862253.920388:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:1.0:1787862253.920394:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223318144:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862253.920420:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223318144:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862253.920426:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00080000:1.0:1787862253.920459:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862254.597480:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246421376:0@lo:400:kworker.0 00000100:00100000:1.0:1787862254.597519:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246421504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862254.597649:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246421248:0@lo:400:kworker.0 00000100:00100000:3.0:1787862254.604560:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862254.604775:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246421632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862254.604912:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421376 00000100:00100000:2.0:1787862254.604929:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421376 00000100:00100000:3.0:1787862254.605409:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246421888:0@lo:400:kworker.0 00000100:00100000:3.0:1787862254.605472:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862254.605523:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421888 00000100:00100000:3.0:1787862254.605528:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421888 00000100:00100000:3.0:1787862254.605589:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862254.605600:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246421888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862254.606075:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862254.606133:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421632 00000100:00100000:1.0:1787862254.606139:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421632 00000100:00100000:1.0:1787862254.606182:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787862254.606192:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246421632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862254.606251:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246421632:12345-0@lo:400:kworker.0 Request processed in 61us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862254.606257:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787862254.606293:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a5a40 x1874709246421632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862254.606305:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246421632:0@lo:400:kworker.0 00000100:00080000:1.0:1787862254.607181:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862254.607186:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862254.607203:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862254.614318:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246421888:12345-0@lo:400:kworker.0 Request processed in 8702us (8828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862254.614366:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862254.614657:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421504 00000100:00100000:2.0:1787862254.614668:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421504 00000100:00100000:2.0:1787862254.614725:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862254.614737:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246421376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862254.614799:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246421376:12345-0@lo:400:kworker.0 Request processed in 65us (10252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862254.614806:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862254.614832:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862254.614840:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246421504:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787862254.614886:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4780 x1874709246421888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862254.614888:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246421504:12345-0@lo:400:kworker.0 Request processed in 46us (7682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862254.614913:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787862254.614926:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246421888:0@lo:400:kworker.0 00000100:00100000:1.0:1787862254.614957:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246421376:0@lo:400:kworker.0 00000100:00080000:2.0:1787862254.614965:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862254.619431:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862254.619511:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421248 00000100:00100000:1.0:1787862254.619528:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421248 00000100:00100000:0.0:1787862254.619534:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246421760:0@lo:400:kworker.0 00000100:00100000:0.0:1787862254.619601:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862254.619613:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787862254.619627:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246421248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862254.619668:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246421760 00000100:00100000:0.0:1787862254.619678:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246421760 00000100:00100000:0.0:1787862254.619752:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862254.619763:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246421760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862254.619784:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246421248:12345-0@lo:400:kworker.0 Request processed in 158us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862254.619797:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787862254.619834:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246421760:12345-0@lo:400:kworker.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862254.619843:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787862254.619874:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862254.619914:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246421248:0@lo:400:kworker.0 00000100:00100000:0.0:1787862254.619929:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246421760:0@lo:400:kworker.0 00000100:00100000:0.0:1787862254.620003:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246421504:0@lo:400:kworker.0 00010000:00010000:1.0:1787862254.737821:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862255.110314:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246422016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862255.110432:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862255.110542:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422016 00000100:00100000:1.0:1787862255.110551:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422016 00000100:00100000:1.0:1787862255.110614:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862255.110906:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246422016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862255.110958:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862255.111019:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246422016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862255.111028:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787862255.111107:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4780 x1874709246422016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862255.111143:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246422016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862255.776794:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862256.774085:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862257.670413:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246422144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862257.670535:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862257.670640:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422144 00000100:00100000:2.0:1787862257.670649:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422144 00000100:00100000:2.0:1787862257.670729:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862257.670742:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246422144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862257.670793:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862257.670853:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246422144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862257.670861:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787862257.670911:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35ed00 x1874709246422144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862257.670941:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246422144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862257.672408:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862257.800005:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862258.822422:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862259.030646:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862259.030691:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862259.030716:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318400 00000100:00100000:3.0:1787862259.030724:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318400 00000100:00100000:3.0:1787862259.030768:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:3.0:1787862259.030775:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2352:x1874709223318400:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862259.030868:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2352:x1874709223318400:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862259.030877:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:0.0:1787862259.031016:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318528 00000100:00100000:0.0:1787862259.031020:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318528 00000100:00100000:0.0:1787862259.031084:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:0.0:1787862259.031089:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108672940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223318528:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862259.031120:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108672940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223318528:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862259.031130:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00080000:3.0:1787862259.031234:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862259.718477:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246422528:0@lo:400:kworker.0 00000100:00100000:0.0:1787862259.718567:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862259.718631:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862259.718636:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246422656:0@lo:400:kworker.0 00000100:00100000:0.0:1787862259.718657:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862259.718699:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422528 00000100:00100000:0.0:1787862259.718707:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422528 00000100:00100000:0.0:1787862259.718772:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862259.718779:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246422528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862259.718827:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246422528:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862259.718832:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787862259.718851:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862259.718882:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246422528:0@lo:400:kworker.0 00000100:00100000:2.0:1787862259.718959:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246422400:0@lo:400:kworker.0 00000100:00100000:2.0:1787862259.718985:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862259.719004:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246422912:0@lo:400:kworker.0 00000100:00100000:2.0:1787862259.719017:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862259.719034:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862259.719068:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246422272:0@lo:400:kworker.0 00000100:00100000:2.0:1787862259.719091:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862259.719103:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246422784:0@lo:400:kworker.0 00000100:00100000:2.0:1787862259.719116:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862259.720265:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422656 00000100:00100000:1.0:1787862259.720288:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422656 00000100:00100000:1.0:1787862259.720354:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422912 00000100:00100000:1.0:1787862259.720356:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422912 00000100:00100000:1.0:1787862259.720374:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787862259.720380:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246422656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862259.720452:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246422656:12345-0@lo:400:kworker.0 Request processed in 71us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862259.720460:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787862259.720496:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862259.720504:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246422912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862259.720538:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246422912:12345-0@lo:400:kworker.0 Request processed in 35us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862259.720542:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862259.720561:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422272 00000100:00100000:1.0:1787862259.720564:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422272 00000100:00100000:1.0:1787862259.720582:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787862259.720587:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246422272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862259.720607:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246422272:12345-0@lo:400:kworker.0 Request processed in 20us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862259.720611:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:1.0:1787862259.720652:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c60b40 x1874709246422656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862259.720663:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246422656:0@lo:400:kworker.0 00000100:00100000:1.0:1787862259.720693:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246422272:0@lo:400:kworker.0 00010000:00080000:1.0:1787862259.720707:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a008388000 x1874709246422912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862259.720717:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a008388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246422912:0@lo:400:kworker.0 00000100:00100000:0.0:1787862259.721354:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422400 00000100:00100000:0.0:1787862259.721361:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422400 00000100:00100000:0.0:1787862259.721383:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246422784 00000100:00100000:0.0:1787862259.721385:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246422784 00000100:00100000:0.0:1787862259.721403:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787862259.721410:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246422400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862259.721464:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246422400:12345-0@lo:400:kworker.0 Request processed in 55us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862259.721471:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787862259.721486:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862259.721493:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246422784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862259.721528:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246422784:12345-0@lo:400:kworker.0 Request processed in 36us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862259.721532:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787862259.721600:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862259.721608:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862259.721610:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862259.722549:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246422784:0@lo:400:kworker.0 00000100:00100000:1.0:1787862259.722564:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246422400:0@lo:400:kworker.0 00010000:00010000:0.0:1787862259.846767:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862260.229160:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246423040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862260.229298:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862260.230969:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423040 00000100:00100000:0.0:1787862260.230993:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423040 00000100:00100000:0.0:1787862260.232231:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787862260.232261:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246423040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862260.232340:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862260.232499:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246423040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862260.243883:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787862260.244186:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4780 x1874709246423040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862260.244222:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246423040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862260.874143:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862261.903022:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862262.792088:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862262.792123:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246423168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862262.792250:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862262.792782:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423168 00000100:00100000:2.0:1787862262.792799:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423168 00000100:00100000:2.0:1787862262.793282:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862262.793296:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246423168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862262.793355:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862262.793448:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246423168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862262.793458:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787862262.793486:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862262.796084:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35ed00 x1874709246423168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862262.796142:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246423168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862262.919896:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862263.940544:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862264.149739:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862264.149815:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862264.149917:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318784 00000100:00100000:2.0:1787862264.149933:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318784 00000100:00100000:2.0:1787862264.150086:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:2.0:1787862264.150102:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223318784:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862264.150237:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223318784:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 139us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862264.150257:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00080000:0.0:1787862264.150423:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862264.150557:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318656 00000100:00100000:3.0:1787862264.150563:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318656 00000100:00100000:3.0:1787862264.150612:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:3.0:1787862264.150621:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2355:x1874709223318656:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862264.150657:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2355:x1874709223318656:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 38us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862264.150665:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:0.0:1787862264.837993:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246423424:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838121:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862264.838192:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1111361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246423936:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838224:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862264.838277:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787862264.838283:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246423296:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838319:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862264.838344:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246423808:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838369:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862264.838404:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246423552:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838433:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862264.838452:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862264.838458:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246423680:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838482:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862264.838523:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423424 00000100:00100000:0.0:1787862264.838535:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423424 00000100:00100000:0.0:1787862264.838593:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423808 00000100:00100000:0.0:1787862264.838596:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423808 00000100:00100000:0.0:1787862264.838636:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423552 00000100:00100000:0.0:1787862264.838638:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423552 00000100:00100000:0.0:1787862264.838658:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862264.838668:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838731:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246423424:12345-0@lo:400:kworker.0 Request processed in 64us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862264.838740:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862264.838760:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862264.838775:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111135680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838806:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111135680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246423808:12345-0@lo:400:kworker.0 Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862264.838813:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862264.838825:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862264.838831:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111135e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246423552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838861:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111135e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246423552:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862264.838866:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862264.838886:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423936 00000100:00100000:0.0:1787862264.838890:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423936 00000100:00100000:0.0:1787862264.838922:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423680 00000100:00100000:0.0:1787862264.838924:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423680 00000100:00100000:0.0:1787862264.838948:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862264.838955:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.838989:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246423936:12345-0@lo:400:kworker.0 Request processed in 35us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862264.838996:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862264.839006:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862264.839012:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111134b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246423680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.839066:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111134b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246423680:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862264.839072:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862264.839092:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246423296 00000100:00100000:0.0:1787862264.839097:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246423296 00000100:00100000:0.0:1787862264.839126:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787862264.839133:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246423296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.839173:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246423296:12345-0@lo:400:kworker.0 Request processed in 40us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862264.839180:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:0.0:1787862264.839225:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862264.839231:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862264.839244:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862264.839296:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c60b40 x1874709246423680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862264.839315:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246423680:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.839327:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246423552:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.839366:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246423296:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.839377:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246423808:0@lo:400:kworker.0 00000100:00100000:0.0:1787862264.839388:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246423424:0@lo:400:kworker.0 00010000:00080000:0.0:1787862264.839398:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1111361c0 x1874709246423936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862264.839408:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1111361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246423936:0@lo:400:kworker.0 00010000:00010000:1.0:1787862264.968217:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862265.349618:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1111361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246424064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862265.351865:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862265.352252:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424064 00000100:00100000:2.0:1787862265.352262:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424064 00000100:00100000:2.0:1787862265.352339:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862265.352353:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246424064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862265.352408:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862265.352487:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246424064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862265.352496:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787862265.352549:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1111361c0 x1874709246424064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862265.352588:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1111361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246424064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862265.989231:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862267.015569:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862267.913289:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246424192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862267.915011:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862267.917178:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424192 00000100:00100000:1.0:1787862267.917199:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424192 00000100:00100000:1.0:1787862267.917298:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862267.917312:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111135a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246424192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862267.917369:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862267.917475:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111135a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246424192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862267.917484:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787862267.919987:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108673480 x1874709246424192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862267.920074:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246424192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862267.920135:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862268.036225:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862269.066560:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862269.289355:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862269.291327:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862269.291665:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319040 00000100:00100000:2.0:1787862269.291684:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319040 00000100:00100000:2.0:1787862269.291760:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:2.0:1787862269.291771:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223319040:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862269.291873:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223319040:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 105us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862269.291879:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00080000:0.0:1787862269.292181:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862269.292953:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223318912 00000100:00100000:1.0:1787862269.292969:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223318912 00000100:00100000:0.0:1787862269.293187:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:0.0:1787862269.293221:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223318912:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862269.293389:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2354:x1874709223318912:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 158us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862269.293397:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:0.0:1787862269.957202:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246424576:0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.957309:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862269.957406:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862269.957412:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111136d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246424704:0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.957446:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862269.957490:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424576 00000100:00100000:0.0:1787862269.957499:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424576 00000100:00100000:0.0:1787862269.957573:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787862269.957584:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111136580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246424576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.957655:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111136580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246424576:12345-0@lo:400:kworker.0 Request processed in 71us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862269.957663:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787862269.957695:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424704 00000100:00100000:0.0:1787862269.957699:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424704 00000100:00100000:0.0:1787862269.957731:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787862269.957758:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.957793:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246424704:12345-0@lo:400:kworker.0 Request processed in 38us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862269.957799:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787862269.957818:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862269.957824:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862269.957867:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111136d00 x1874709246424704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862269.957884:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111136d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246424704:0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.957897:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246424576:0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.958014:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111134f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246424448:0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.958070:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862269.958097:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246424960:0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.958128:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862269.958154:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787862269.958159:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111134780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246424320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.958204:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862269.958224:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246424832:0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.958246:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862269.960714:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424448 00000100:00100000:0.0:1787862269.960741:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424448 00000100:00100000:0.0:1787862269.960845:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424832 00000100:00100000:0.0:1787862269.960849:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424832 00000100:00100000:0.0:1787862269.960902:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787862269.960916:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108673840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246424448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.961132:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787862269.961143:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246424832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.961237:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246424832:12345-0@lo:400:kworker.0 Request processed in 95us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862269.961268:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787862269.961337:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246424832:0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.961458:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108673840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246424448:12345-0@lo:400:kworker.0 Request processed in 545us (3386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862269.961465:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787862269.961490:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424960 00000100:00100000:0.0:1787862269.961495:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424960 00000100:00100000:0.0:1787862269.961529:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862269.961537:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246424960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.961576:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246424960:12345-0@lo:400:kworker.0 Request processed in 40us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862269.961583:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862269.961614:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246424320 00000100:00100000:0.0:1787862269.961618:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246424320 00000100:00100000:0.0:1787862269.961647:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787862269.961654:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246424320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862269.961687:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246424320:12345-0@lo:400:kworker.0 Request processed in 34us (3483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862269.961694:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1787862269.961749:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862269.961755:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862269.961894:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111134780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246424320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862269.961909:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111134f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246424448:0@lo:400:kworker.0 00010000:00080000:3.0:1787862269.961925:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111137480 x1874709246424960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862269.961936:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246424960:0@lo:400:kworker.0 00010000:00010000:0.0:1787862270.099849:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862270.477116:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862270.477148:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246425088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862270.477265:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862270.477350:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425088 00000100:00100000:3.0:1787862270.477375:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425088 00000100:00100000:3.0:1787862270.477444:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787862270.477455:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108671e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246425088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862270.477505:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862270.477567:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108671e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246425088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862270.477576:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787862270.477626:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4780 x1874709246425088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862270.477653:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246425088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862271.108427:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862272.137635:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862273.028867:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246425216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862273.028993:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862273.029192:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425216 00000100:00100000:0.0:1787862273.029208:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425216 00000100:00100000:0.0:1787862273.029353:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862273.029374:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111136d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246425216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862273.034427:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862273.034659:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111136d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246425216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5286us (5660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.034672:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787862273.034730:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862273.034896:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111137840 x1874709246425216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862273.034934:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246425216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862273.156623:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787862273.158116:0:10137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:24:31 (1787862271) === 00000100:00100000:0.0:1787862273.763294:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862273.763425:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319168 00000100:00100000:2.0:1787862273.763438:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319168 00000100:00100000:2.0:1787862273.763503:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:2.0:1787862273.763513:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:8151:x1874709223319168:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862273.763534:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862273.763569:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79fa00/0x391a6cd368cd9bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c04ec expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.763604:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79fa00/0x391a6cd368cd9bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04ec expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.763617:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79fa00/0x391a6cd368cd9bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04ec expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.763628:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79fa00, rc 0) 00000100:00100000:2.0:1787862273.763711:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8151:x1874709223319168:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 199us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862273.763737:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:0.0:1787862273.800145:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862273.800377:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319296 00000100:00100000:2.0:1787862273.800391:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319296 00000100:00100000:2.0:1787862273.800469:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:2.0:1787862273.800482:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8151:x1874709223319296:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787862273.800901:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8151:x1874709223319296:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 421us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862273.800910:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:1.0:1787862273.813243:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862273.813368:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319424 00000100:00100000:0.0:1787862273.813382:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319424 00000100:00100000:0.0:1787862273.813462:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:0.0:1787862273.813476:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8151:x1874709223319424:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787862273.813974:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8151:x1874709223319424:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 500us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.813983:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:1.0:1787862273.822891:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862273.823100:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319552 00000100:00100000:0.0:1787862273.823115:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319552 00000100:00100000:0.0:1787862273.823210:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 215 00000100:00100000:0.0:1787862273.823222:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8155:x1874709223319552:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862273.823628:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8155:x1874709223319552:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 406us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.823639:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 215 00000100:00100000:3.0:1787862273.872380:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862273.872699:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319680 00000100:00100000:2.0:1787862273.872714:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319680 00000100:00100000:2.0:1787862273.872794:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:2.0:1787862273.872815:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8155:x1874709223319680:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862273.873242:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8155:x1874709223319680:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 428us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862273.873252:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:1.0:1787862273.892442:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862273.893434:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319808 00000100:00100000:2.0:1787862273.893459:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319808 00000100:00100000:2.0:1787862273.893678:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 217 00000100:00100000:2.0:1787862273.893691:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:8151:x1874709223319808:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862273.893719:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862273.893749:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e600/0x391a6cd368cd9bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0516 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.893809:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e600/0x391a6cd368cd9bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0516 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.893864:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e600/0x391a6cd368cd9bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0516 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.893880:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e600, rc 0) 00000100:00100000:2.0:1787862273.894004:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:8151:x1874709223319808:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 315us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862273.894013:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 217 00000100:00100000:1.0:1787862273.902510:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862273.902985:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223319936 00000100:00100000:0.0:1787862273.903000:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223319936 00000100:00100000:0.0:1787862273.903134:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:0.0:1787862273.903156:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:8151:x1874709223319936:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787862273.903205:0:5863:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787862273.903244:0:5863:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787862273.903250:0:5863:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787862273.903254:0:5863:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787862273.903256:0:5863:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787862273.907847:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:8151:x1874709223319936:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 4683us (5339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.907870:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:1.0:1787862273.924383:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862273.930492:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320064 00000100:00100000:2.0:1787862273.930517:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320064 00000100:00100000:2.0:1787862273.930984:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 219 00000100:00100000:2.0:1787862273.930996:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:8151:x1874709223320064:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862273.931017:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862273.931065:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c051d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.931105:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.931117:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862273.931127:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79ee00, rc 0) 00000100:00100000:2.0:1787862273.931239:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8151:x1874709223320064:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 245us (6874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862273.931245:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 219 00000100:00100000:1.0:1787862273.938108:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862273.943929:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320192 00000100:00100000:0.0:1787862273.943959:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320192 00000100:00100000:0.0:1787862273.944051:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:0.0:1787862273.944066:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8151:x1874709223320192:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787862273.944501:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8151:x1874709223320192:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 437us (6405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.944512:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:0.0:1787862273.952385:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862273.952725:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320320 00000100:00100000:2.0:1787862273.952755:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320320 00000100:00100000:2.0:1787862273.952933:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 221 00000100:00100000:2.0:1787862273.952946:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8151:x1874709223320320:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787862273.953360:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8151:x1874709223320320:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 414us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862273.953371:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 221 00000100:00100000:1.0:1787862273.959826:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862273.961781:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320448 00000100:00100000:0.0:1787862273.961867:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320448 00000100:00100000:0.0:1787862273.961946:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:0.0:1787862273.962058:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8160:x1874709223320448:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862273.962434:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8160:x1874709223320448:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 476us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.962443:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:1.0:1787862273.974391:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862273.974498:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320576 00000100:00100000:0.0:1787862273.974512:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320576 00000100:00100000:0.0:1787862273.974600:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 223 00000100:00100000:0.0:1787862273.974613:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8160:x1874709223320576:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862273.975008:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:8160:x1874709223320576:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 395us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862273.975019:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 223 00000100:00100000:1.0:1787862273.988336:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862273.988392:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862273.988834:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320704 00000100:00100000:3.0:1787862273.988848:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320704 00000100:00100000:3.0:1787862273.988912:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320832 00000100:00100000:3.0:1787862273.988915:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320832 00000100:00100000:3.0:1787862273.988984:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:3.0:1787862273.988996:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223320832:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862273.989140:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223320832:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 145us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862273.989158:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:3.0:1787862273.989181:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862273.989186:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874709223320704:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787862273.989223:0:5870:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 8e4a3c95-44f3-4a05-aca3-5d290a7788c7@192.168.202.9@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:3.0:1787862273.989270:0:5870:0:(genops.c:1385:class_connect()) connect: client 8e4a3c95-44f3-4a05-aca3-5d290a7788c7, cookie 0x391a6cd368cd9be4 00000004:00100000:3.0:1787862273.989313:0:5870:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787862273.990814:0:5870:0:(import.c:65:import_set_state_nolock()) ffff89a1087e4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862273.990903:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2351:x1874709223320704:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 1712us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862273.990917:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00080000:3.0:1787862273.991327:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862274.002114:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862274.002181:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862274.002336:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321088 00000100:00100000:2.0:1787862274.002349:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321088 00000100:00100000:2.0:1787862274.002440:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223320960 00000100:00100000:2.0:1787862274.002443:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223320960 00000100:00100000:2.0:1787862274.002465:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1787862274.002475:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+7:8151:x1874709223321088:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787862274.002546:0:5868:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787862274.002658:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+7:8151:x1874709223321088:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 183us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862274.002677:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1787862274.002697:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1787862274.002704:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:0:x1874709223320960:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787862274.002715:0:5868:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787862274.002735:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:0:x1874709223320960:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862274.002742:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00080000:0.0:1787862274.002981:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862274.017186:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862274.017724:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321216 00000100:00100000:2.0:1787862274.017739:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321216 00000100:00100000:2.0:1787862274.017831:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1787862274.017843:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:8151:x1874709223321216:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787862274.018288:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:8151:x1874709223321216:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 445us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862274.018298:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1787862274.024820:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862274.025018:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321600 00000100:00100000:0.0:1787862274.025036:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321600 00000100:00100000:0.0:1787862274.025174:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1787862274.025206:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:8151:x1874709223321600:12345-192.168.202.9@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787862274.025603:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787862274.025824:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:8151:x1874709223321600:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 618us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862274.025836:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1787862274.029263:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862274.029323:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862274.029447:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321344 00000100:00100000:2.0:1787862274.029462:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321344 00000100:00100000:2.0:1787862274.029524:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321472 00000100:00100000:2.0:1787862274.029527:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321472 00000100:00100000:2.0:1787862274.029567:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1787862274.029577:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874709223321344:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787862274.029630:0:6711:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 8e4a3c95-44f3-4a05-aca3-5d290a7788c7@192.168.202.9@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:2.0:1787862274.029695:0:6711:0:(genops.c:1385:class_connect()) connect: client 8e4a3c95-44f3-4a05-aca3-5d290a7788c7, cookie 0x391a6cd368cd9beb 00002000:00100000:2.0:1787862274.029713:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8e4a3c95-44f3-4a05-aca3-5d290a7788c7/ffff89a11106f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787862274.029729:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787862274.029994:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1787862274.030002:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874709223321472:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787862274.030023:0:6712:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 8e4a3c95-44f3-4a05-aca3-5d290a7788c7@192.168.202.9@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:3.0:1787862274.030086:0:6712:0:(genops.c:1385:class_connect()) connect: client 8e4a3c95-44f3-4a05-aca3-5d290a7788c7, cookie 0x391a6cd368cd9bf2 00002000:00100000:3.0:1787862274.030093:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8e4a3c95-44f3-4a05-aca3-5d290a7788c7/ffff89a1087e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862274.030119:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787862274.030460:0:6712:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787862274.030511:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a1087e0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862274.030650:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2351:x1874709223321472:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 644us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862274.030660:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00002000:00080000:2.0:1787862274.033527:0:6711:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787862274.033598:0:6711:0:(import.c:65:import_set_state_nolock()) ffff89a11106b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862274.033725:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2351:x1874709223321344:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 4144us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862274.033740:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00010000:00010000:1.0:1787862274.182121:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787862274.244181:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000100:00100000:3.0:1787862275.078301:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246425472:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.078408:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862275.078479:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246425984:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.078550:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862275.078592:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787862275.078599:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108672d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246425344:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.078634:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862275.078657:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246425856:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.078682:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862275.078946:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246425600:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.078979:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862275.079093:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862275.079099:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246425728:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.079125:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862275.088218:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425472 00000100:00100000:1.0:1787862275.088237:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425472 00000100:00100000:3.0:1787862275.089610:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425856 00000100:00100000:3.0:1787862275.089627:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425856 00000100:00100000:3.0:1787862275.089741:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425600 00000100:00100000:3.0:1787862275.089746:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425600 00000100:00100000:3.0:1787862275.089779:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787862275.089791:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246425856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.089938:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246425856:12345-0@lo:400:kworker.0 Request processed in 149us (11254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862275.089947:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787862275.089968:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787862275.089974:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246425600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787862275.090177:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862275.090439:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246425600:12345-0@lo:400:kworker.0 Request processed in 463us (11457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862275.090446:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787862275.090473:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425984 00000100:00100000:3.0:1787862275.090479:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425984 00000100:00100000:2.0:1787862275.090625:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246425600:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.090733:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425728 00000100:00100000:3.0:1787862275.090738:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425728 00000100:00100000:3.0:1787862275.090765:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787862275.090774:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246425984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.090825:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246425984:12345-0@lo:400:kworker.0 Request processed in 54us (12276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862275.090832:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787862275.090843:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787862275.090850:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246425728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.090884:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246425728:12345-0@lo:400:kworker.0 Request processed in 35us (11758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862275.090890:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787862275.090906:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862275.090909:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787862275.090933:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086730c0 x1874709246425728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862275.090959:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246425728:0@lo:400:kworker.0 00000100:00100000:3.0:1787862275.090994:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246425856:0@lo:400:kworker.0 00010000:00080000:3.0:1787862275.091217:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108672580 x1874709246425984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862275.091227:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246425984:0@lo:400:kworker.0 00000100:00100000:0.0:1787862275.091741:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246425344 00000100:00100000:0.0:1787862275.091749:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246425344 00000100:00100000:0.0:1787862275.091955:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787862275.091965:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246425344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862275.092080:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246425344:12345-0@lo:400:kworker.0 Request processed in 117us (13444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862275.092088:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787862275.092262:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108672d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246425344:0@lo:400:kworker.0 00000100:00100000:0.0:1787862275.098194:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787862275.098214:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246425472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862275.098373:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246425472:12345-0@lo:400:kworker.0 Request processed in 163us (19965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862275.098382:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787862275.100544:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246425472:0@lo:400:kworker.0 00010000:00010000:2.0:1787862275.204603:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862275.593370:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246426112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862275.593483:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862275.594129:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426112 00000100:00100000:0.0:1787862275.594151:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426112 00000100:00100000:0.0:1787862275.594217:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787862275.594231:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246426112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862275.594267:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862275.594348:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246426112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862275.594356:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787862275.594409:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111137480 x1874709246426112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862275.594442:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246426112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862276.231893:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862277.252238:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862278.148373:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862278.148411:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246426240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862278.148537:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862278.148736:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426240 00000100:00100000:0.0:1787862278.148748:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426240 00000100:00100000:0.0:1787862278.148842:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862278.148855:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246426240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862278.148917:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862278.148990:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246426240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862278.148997:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787862278.149025:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862278.149091:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111137480 x1874709246426240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862278.149130:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246426240:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787862278.221228:0:5890:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000001:00100000:0.0:1787862278.233885:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00010000:00010000:2.0:1787862278.276834:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862279.300367:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862279.514592:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862279.514656:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862279.514695:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862279.514736:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862279.514771:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862279.514820:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322240 00000100:00100000:0.0:1787862279.514821:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321984 00000100:00100000:1.0:1787862279.514833:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322240 00000100:00100000:0.0:1787862279.514833:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321984 00000100:00100000:2.0:1787862279.514911:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321728 00000100:00100000:2.0:1787862279.514916:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321728 00000100:00100000:1.0:1787862279.514920:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322112 00000100:00100000:1.0:1787862279.514923:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322112 00000100:00100000:2.0:1787862279.514964:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 225 00000100:00100000:2.0:1787862279.514975:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223321728:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862279.515112:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223321728:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 138us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862279.515121:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 225 00000100:00100000:3.0:1787862279.515266:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223321856 00000100:00100000:3.0:1787862279.515272:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223321856 00000100:00100000:0.0:1787862279.520038:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:0.0:1787862279.520086:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223321984:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862279.520220:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223321984:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 145us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862279.520228:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:0.0:1787862279.520311:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1787862279.520322:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223322240:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862279.520379:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223322240:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 60us (5683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862279.520386:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:1.0:1787862279.521706:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1787862279.521725:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223322112:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862279.521828:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223322112:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 108us (7054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862279.521835:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00080000:2.0:1787862279.523776:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862279.523799:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862279.523802:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862279.525004:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:3.0:1787862279.525022:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223321856:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862279.525179:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223321856:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 163us (10441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862279.525188:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:3.0:1787862280.197101:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1111370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246426624:0@lo:400:kworker.0 00000100:00100000:3.0:1787862280.197216:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862280.197292:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862280.197299:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246426752:0@lo:400:kworker.0 00000100:00100000:3.0:1787862280.197328:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862280.197470:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111134b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246426496:0@lo:400:kworker.0 00000100:00100000:2.0:1787862280.197508:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862280.197536:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111134780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246427008:0@lo:400:kworker.0 00000100:00100000:2.0:1787862280.197557:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862280.197580:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862280.197586:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1111343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246426368:0@lo:400:kworker.0 00000100:00100000:2.0:1787862280.197615:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862280.197636:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111134f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246426880:0@lo:400:kworker.0 00000100:00100000:2.0:1787862280.197660:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862280.198069:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426368 00000100:00100000:0.0:1787862280.198080:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426368 00000100:00100000:0.0:1787862280.198146:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787862280.198157:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246426368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862280.198226:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246426368:12345-0@lo:400:kworker.0 Request processed in 70us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862280.198233:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787862280.198275:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426752 00000100:00100000:0.0:1787862280.198279:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426752 00000100:00100000:0.0:1787862280.198314:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427008 00000100:00100000:0.0:1787862280.198317:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427008 00000100:00100000:0.0:1787862280.198340:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862280.198347:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862280.198384:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246426752:12345-0@lo:400:kworker.0 Request processed in 37us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862280.198391:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862280.198402:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787862280.198408:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862280.198432:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246427008:12345-0@lo:400:kworker.0 Request processed in 25us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862280.198438:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787862280.198704:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426624 00000100:00100000:0.0:1787862280.198709:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426624 00000100:00100000:3.0:1787862280.198854:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426496 00000100:00100000:3.0:1787862280.198882:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426496 00000100:00100000:0.0:1787862280.198934:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246426880 00000100:00100000:0.0:1787862280.198938:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246426880 00000100:00100000:1.0:1787862280.199183:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787862280.199209:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246426624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862280.199272:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246426624:12345-0@lo:400:kworker.0 Request processed in 79us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862280.199281:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787862280.201757:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862280.201771:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862280.201796:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862280.201880:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1111343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246426368:0@lo:400:kworker.0 00010000:00080000:2.0:1787862280.201910:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111134780 x1874709246427008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862280.201925:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111134780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246427008:0@lo:400:kworker.0 00010000:00080000:2.0:1787862280.202031:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111137480 x1874709246426752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862280.202076:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246426752:0@lo:400:kworker.0 00000100:00100000:2.0:1787862280.202109:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1111370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246426624:0@lo:400:kworker.0 00000100:00100000:3.0:1787862280.208653:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862280.208677:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246426496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862280.208865:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246426496:12345-0@lo:400:kworker.0 Request processed in 196us (11355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862280.208875:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862280.208978:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111134b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246426496:0@lo:400:kworker.0 00000100:00100000:0.0:1787862280.219326:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787862280.219363:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246426880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862280.219511:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246426880:12345-0@lo:400:kworker.0 Request processed in 168us (21848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862280.219519:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862280.219671:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111134f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246426880:0@lo:400:kworker.0 00010000:00010000:1.0:1787862280.325467:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862280.708495:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246427136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862280.708609:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862280.709784:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427136 00000100:00100000:0.0:1787862280.709800:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427136 00000100:00100000:0.0:1787862280.709892:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862280.709905:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246427136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862280.710134:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862280.710241:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246427136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862280.710250:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787862280.712219:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111136940 x1874709246427136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862280.712254:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246427136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862281.348863:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862282.222012:0:10337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787862282.380368:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862283.268333:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246427264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862283.268439:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862283.268797:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427264 00000100:00100000:0.0:1787862283.268807:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427264 00000100:00080000:1.0:1787862283.268859:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862283.268879:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862283.268890:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246427264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862283.268941:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862283.269000:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246427264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862283.269009:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787862283.269037:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111136940 x1874709246427264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862283.269095:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246427264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862283.396522:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862284.420513:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862284.631115:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862284.631170:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862284.631204:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862284.631230:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862284.631272:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862284.631310:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322752 00000100:00100000:0.0:1787862284.631323:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322752 00000100:00100000:0.0:1787862284.631400:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322880 00000100:00100000:0.0:1787862284.631403:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322880 00000100:00100000:0.0:1787862284.631432:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:0.0:1787862284.631444:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111134f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223322752:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862284.631550:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111134f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223322752:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 107us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862284.631559:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:0.0:1787862284.631581:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:0.0:1787862284.631588:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223322880:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862284.631616:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223322880:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862284.631623:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:0.0:1787862284.631643:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322368 00000100:00100000:0.0:1787862284.631647:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322368 00000100:00100000:0.0:1787862284.631675:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 227 00000100:00100000:0.0:1787862284.631682:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223322368:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862284.631708:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223322368:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862284.631715:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 227 00000100:00100000:0.0:1787862284.631744:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322496 00000100:00100000:0.0:1787862284.631748:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322496 00000100:00100000:0.0:1787862284.631774:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223322624 00000100:00100000:0.0:1787862284.631777:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223322624 00000100:00100000:0.0:1787862284.631801:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:0.0:1787862284.631833:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223322496:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862284.631868:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223322496:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 51us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862284.631875:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:0.0:1787862284.631887:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:0.0:1787862284.631893:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111134b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223322624:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862284.631917:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111134b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223322624:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862284.631923:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00080000:0.0:1787862284.631945:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862284.631951:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862284.631953:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862285.316417:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1111343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246427648:0@lo:400:kworker.0 00000100:00100000:2.0:1787862285.316573:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111134780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246427520:0@lo:400:kworker.0 00000100:00100000:2.0:1787862285.316721:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862285.316799:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246428032:0@lo:400:kworker.0 00000100:00100000:2.0:1787862285.316850:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862285.316891:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862285.316897:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246427392:0@lo:400:kworker.0 00000100:00100000:2.0:1787862285.316929:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862285.316953:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246427904:0@lo:400:kworker.0 00000100:00100000:2.0:1787862285.316977:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862285.317032:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427392 00000100:00100000:2.0:1787862285.317086:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427392 00000100:00100000:2.0:1787862285.317146:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787862285.317158:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246427392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862285.317223:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246427392:12345-0@lo:400:kworker.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862285.317243:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787862285.317311:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246427392:0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.317475:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862285.317510:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862285.317517:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246427776:0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.317545:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862285.317592:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427520 00000100:00100000:0.0:1787862285.317597:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427520 00000100:00100000:0.0:1787862285.317633:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427904 00000100:00100000:0.0:1787862285.317637:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427904 00000100:00100000:0.0:1787862285.317663:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427648 00000100:00100000:0.0:1787862285.317666:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427648 00000100:00100000:0.0:1787862285.317681:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862285.317688:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.317731:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246427520:12345-0@lo:400:kworker.0 Request processed in 43us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862285.317751:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862285.317766:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787862285.317772:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246427904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.317804:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246427904:12345-0@lo:400:kworker.0 Request processed in 32us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862285.317810:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787862285.317821:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862285.317827:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246427648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.317859:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246427648:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862285.317866:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862285.317888:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428032 00000100:00100000:0.0:1787862285.317891:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428032 00000100:00100000:0.0:1787862285.317920:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246427776 00000100:00100000:0.0:1787862285.317922:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246427776 00000100:00100000:0.0:1787862285.317942:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862285.317949:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.317982:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246428032:12345-0@lo:400:kworker.0 Request processed in 35us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862285.317990:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862285.318001:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862285.318007:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246427776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.318072:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246427776:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862285.318079:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787862285.318118:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862285.318123:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862285.318126:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862285.318160:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246427904:0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.318171:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111134780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246427520:0@lo:400:kworker.0 00010000:00080000:0.0:1787862285.318184:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c4ca580 x1874709246428032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862285.318195:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246428032:0@lo:400:kworker.0 00010000:00080000:0.0:1787862285.318429:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a111137840 x1874709246427776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862285.318439:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246427776:0@lo:400:kworker.0 00000100:00100000:0.0:1787862285.318449:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1111343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246427648:0@lo:400:kworker.0 00010000:00010000:0.0:1787862285.452305:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862285.839879:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862285.839912:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246428160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862285.840006:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862285.840125:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428160 00000100:00100000:0.0:1787862285.840134:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428160 00000100:00100000:0.0:1787862285.840196:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787862285.840207:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246428160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862285.840260:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862285.840318:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246428160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862285.840327:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787862285.840383:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c4ca580 x1874709246428160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862285.840417:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246428160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862286.468281:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862287.492687:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862288.388716:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246428288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862288.388835:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862288.389008:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428288 00000100:00100000:2.0:1787862288.389037:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428288 00000100:00100000:2.0:1787862288.389153:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787862288.389166:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246428288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862288.389219:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862288.389290:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246428288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862288.389299:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787862288.389580:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c4ca580 x1874709246428288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862288.389611:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246428288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862288.389733:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862288.516337:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862289.545233:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862289.756941:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862289.757020:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862289.757104:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862289.757129:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862289.757156:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862289.757191:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323008 00000100:00100000:0.0:1787862289.757203:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323008 00000100:00100000:0.0:1787862289.757279:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:0.0:1787862289.757291:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223323008:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862289.757406:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223323008:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862289.757414:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:0.0:1787862289.757460:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323136 00000100:00100000:0.0:1787862289.757464:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323136 00000100:00100000:0.0:1787862289.757508:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323264 00000100:00100000:0.0:1787862289.757511:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323264 00000100:00100000:0.0:1787862289.757533:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:0.0:1787862289.757540:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223323136:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862289.757574:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223323136:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862289.757581:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:0.0:1787862289.757592:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:0.0:1787862289.757598:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223323264:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862289.757641:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223323264:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 43us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862289.757647:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:0.0:1787862289.757668:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323392 00000100:00100000:0.0:1787862289.757672:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323392 00000100:00100000:0.0:1787862289.757846:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323520 00000100:00100000:0.0:1787862289.757850:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323520 00000100:00100000:0.0:1787862289.757875:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1787862289.757881:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120583840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223323392:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862289.757913:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120583840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223323392:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 32us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862289.757919:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1787862289.757932:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:0.0:1787862289.757938:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223323520:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862289.757962:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223323520:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862289.757968:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00080000:0.0:1787862289.758195:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862289.758200:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862289.758203:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862290.441296:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246428416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862290.441336:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246428800:0@lo:400:kworker.0 00000100:00100000:2.0:1787862290.441449:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246428544:0@lo:400:kworker.0 00000100:00100000:3.0:1787862290.441456:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246428672:0@lo:400:kworker.0 00000100:00100000:1.0:1787862290.444943:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862290.445106:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246428928:0@lo:400:kworker.0 00000100:00100000:1.0:1787862290.445170:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862290.445220:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428416 00000100:00100000:1.0:1787862290.445229:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428416 00000100:00100000:1.0:1787862290.445282:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787862290.445292:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246428416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862290.445352:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246428416:12345-0@lo:400:kworker.0 Request processed in 61us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862290.445378:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787862290.445418:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428928 00000100:00100000:1.0:1787862290.445422:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428928 00000100:00100000:1.0:1787862290.445955:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787862290.446105:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246428928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862290.446166:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246428928:12345-0@lo:400:kworker.0 Request processed in 204us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862290.446173:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787862290.446200:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862290.446243:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246428928:0@lo:400:kworker.0 00000100:00100000:1.0:1787862290.446255:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246428416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862290.448882:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862290.452312:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428800 00000100:00100000:1.0:1787862290.452332:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428800 00000100:00080000:0.0:1787862290.452569:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862290.452625:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787862290.452638:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862290.452772:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246428800:12345-0@lo:400:kworker.0 Request processed in 138us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862290.452781:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862290.455376:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862290.455595:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246429056:0@lo:400:kworker.0 00000100:00100000:2.0:1787862290.455670:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862290.455733:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428544 00000100:00100000:2.0:1787862290.455742:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428544 00000100:00100000:2.0:1787862290.455804:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787862290.455813:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246428544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862290.455877:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246428544:12345-0@lo:400:kworker.0 Request processed in 64us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862290.455901:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787862290.455928:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429056 00000100:00100000:2.0:1787862290.455931:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429056 00000100:00100000:2.0:1787862290.456003:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862290.456012:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246429056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862290.456071:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246429056:12345-0@lo:400:kworker.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862290.456078:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862290.456134:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246428544:0@lo:400:kworker.0 00010000:00080000:2.0:1787862290.456150:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a4780 x1874709246429056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862290.456161:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246429056:0@lo:400:kworker.0 00000100:00100000:3.0:1787862290.462289:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862290.462582:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246428672 00000100:00100000:2.0:1787862290.462596:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246428672 00000100:00100000:2.0:1787862290.463148:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787862290.463163:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246428672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862290.463275:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246428672:12345-0@lo:400:kworker.0 Request processed in 116us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862290.463283:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1787862290.466687:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862290.466703:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787862290.466776:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a120461a40 x1874709246428800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862290.466821:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246428800:0@lo:400:kworker.0 00000100:00100000:3.0:1787862290.470334:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246428672:0@lo:400:kworker.0 00010000:00010000:2.0:1787862290.564342:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862290.949212:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862290.949248:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246429184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862290.949355:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862290.949467:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429184 00000100:00100000:0.0:1787862290.949478:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429184 00000100:00100000:0.0:1787862290.949536:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862290.949545:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246429184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862290.949592:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862290.949643:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246429184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862290.949650:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787862290.949698:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a7480 x1874709246429184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862290.949720:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246429184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862291.595342:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862292.612329:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862293.518129:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862293.518162:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246429312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862293.518266:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862293.518687:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429312 00000100:00100000:0.0:1787862293.518698:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429312 00000100:00100000:0.0:1787862293.518776:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787862293.518787:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246429312:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862293.519950:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787862293.522747:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862293.522907:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246429312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4116us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862293.522921:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787862293.523428:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a141b28f00 x1874709246429312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862293.523469:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246429312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862293.636250:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862294.660446:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862294.870816:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862294.870901:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862294.870960:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862294.870983:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862294.871011:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862294.871716:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323648 00000100:00100000:1.0:1787862294.871732:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323648 00000100:00100000:1.0:1787862294.871799:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:1.0:1787862294.871811:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223323648:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862294.871908:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223323648:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 99us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862294.871917:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:1.0:1787862294.871979:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324032 00000100:00100000:1.0:1787862294.871984:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324032 00000100:00100000:1.0:1787862294.872030:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324160 00000100:00100000:1.0:1787862294.872034:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324160 00000100:00100000:1.0:1787862294.872077:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862294.872083:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2351:x1874709223324032:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:1.0:1787862294.872109:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9beb 00000100:00080000:1.0:1787862294.872122:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a11106b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787862294.872173:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787862294.872557:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+2:2351:x1874709223324032:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 472us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862294.872565:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862294.872580:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1787862294.872587:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2351:x1874709223324160:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:1.0:1787862294.872611:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9bf2 00000100:00080000:1.0:1787862294.872618:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a1087e0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787862294.872644:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787862294.872835:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+2:2351:x1874709223324160:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 248us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862294.872842:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:0.0:1787862294.875309:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787862294.876417:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862294.876428:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862294.881665:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862294.897855:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323776 00000100:00100000:2.0:1787862294.897903:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323776 00000100:00080000:3.0:1787862294.898697:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862294.898736:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223323904 00000100:00100000:2.0:1787862294.898745:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223323904 00000100:00100000:2.0:1787862294.898840:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:2.0:1787862294.898855:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223323776:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862294.899201:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223323776:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 348us (28401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862294.899210:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:2.0:1787862294.899240:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:2.0:1787862294.899248:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223323904:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862294.899279:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223323904:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 32us (28268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862294.899285:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00080000:3.0:1787862294.909514:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862295.557103:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108672d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246429568:0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.557205:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862295.557277:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246430080:0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.557304:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862295.557342:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862295.557348:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246429440:0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.557380:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862295.557400:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246429952:0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.557423:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862295.557454:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246429696:0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.557481:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862295.557499:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862295.557525:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246429824:0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.557551:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862295.557585:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429568 00000100:00100000:0.0:1787862295.557835:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429952 00000100:00100000:0.0:1787862295.557842:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429952 00000100:00100000:0.0:1787862295.557928:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429696 00000100:00100000:0.0:1787862295.557931:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429696 00000100:00100000:0.0:1787862295.557964:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787862295.557977:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111134780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246429952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862295.558081:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111134780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246429952:12345-0@lo:400:kworker.0 Request processed in 106us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862295.558090:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787862295.558109:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787862295.558115:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111136940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862295.558150:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111136940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246429696:12345-0@lo:400:kworker.0 Request processed in 35us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862295.558157:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787862295.558202:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246429696:0@lo:400:kworker.0 00000100:00100000:0.0:1787862295.558240:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246429952:0@lo:400:kworker.0 00000100:00080000:3.0:1787862295.558309:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862295.558931:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430080 00000100:00100000:1.0:1787862295.558938:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430080 00000100:00100000:2.0:1787862295.562158:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429568 00000100:00100000:2.0:1787862295.562283:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787862295.562297:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246429568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.562454:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246429568:12345-0@lo:400:kworker.0 Request processed in 160us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862295.562463:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787862295.562553:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108672d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246429568:0@lo:400:kworker.0 00000100:00100000:1.0:1787862295.564902:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429824 00000100:00100000:1.0:1787862295.564922:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429824 00000100:00100000:2.0:1787862295.565132:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862295.565148:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246430080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.565314:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246430080:12345-0@lo:400:kworker.0 Request processed in 170us (8007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862295.565323:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862295.565359:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246429440 00000100:00100000:2.0:1787862295.565364:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246429440 00000100:00100000:2.0:1787862295.565400:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787862295.565406:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246429440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862295.565443:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246429440:12345-0@lo:400:kworker.0 Request processed in 37us (8062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862295.565450:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787862295.565520:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246429440:0@lo:400:kworker.0 00010000:00080000:2.0:1787862295.565543:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086712c0 x1874709246430080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862295.565583:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246430080:0@lo:400:kworker.0 00000100:00080000:3.0:1787862295.569372:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862295.569389:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862295.571871:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862295.571896:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246429824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862295.572084:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246429824:12345-0@lo:400:kworker.0 Request processed in 199us (14529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862295.572103:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787862295.585582:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086721c0 x1874709246429824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862295.585781:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246429824:0@lo:400:kworker.0 00010000:00010000:3.0:1787862295.685635:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862296.068796:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862296.068824:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862296.068930:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862296.069023:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430208 00000100:00100000:2.0:1787862296.069033:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430208 00000100:00100000:2.0:1787862296.069112:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862296.069123:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246430208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862296.069176:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862296.069234:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246430208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862296.069243:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787862296.069295:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108674000 x1874709246430208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862296.069453:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246430208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862296.708501:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862297.732822:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862298.629478:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862298.629511:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246430336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862298.629765:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862298.642774:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430336 00000100:00100000:2.0:1787862298.642794:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430336 00000100:00100000:2.0:1787862298.642896:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787862298.642909:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246430336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862298.642977:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862298.643153:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246430336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (13387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862298.643162:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787862298.646246:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862298.646366:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a141b2b0c0 x1874709246430336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862298.646406:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246430336:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787862298.757228:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000020:00000080:0.0:1787862298.757243:0:6736:0:(genops.c:885:class_export_put()) final put ffff89a11106f800/8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000020:00000080:0.0:1787862298.757279:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a11106f800/8e4a3c95-44f3-4a05-aca3-5d290a7788c7 for lustre-OST0000 00000020:00000080:0.0:1787862298.757677:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a11106b800 for lustre-OST0000 00010000:00010000:3.0:1787862298.765029:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787862299.736563:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000020:00000080:1.0:1787862299.736575:0:7661:0:(genops.c:885:class_export_put()) final put ffff89a1087e1800/8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000020:00000080:1.0:1787862299.736603:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1087e1800/8e4a3c95-44f3-4a05-aca3-5d290a7788c7 for lustre-OST0001 00000020:00000080:1.0:1787862299.736651:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a1087e0000 for lustre-OST0001 00010000:00010000:0.0:1787862299.781232:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862299.993207:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862299.993257:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862299.993301:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862299.993648:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324544 00000100:00100000:2.0:1787862299.993663:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324544 00000100:00100000:2.0:1787862299.993746:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324416 00000100:00100000:2.0:1787862299.993750:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324416 00000100:00100000:2.0:1787862299.993779:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:2.0:1787862299.993790:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223324544:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862299.993926:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223324544:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 136us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862299.993935:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:2.0:1787862299.993956:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:2.0:1787862299.993963:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223324416:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862299.993989:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223324416:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862299.993995:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00080000:2.0:1787862299.994019:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862299.994978:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324288 00000100:00100000:1.0:1787862299.994992:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324288 00000100:00100000:1.0:1787862300.000080:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 233 00000100:00100000:1.0:1787862300.000117:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223324288:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862300.000242:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223324288:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 142us (7051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862300.000253:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 233 00000100:00100000:0.0:1787862300.685325:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246430720:0@lo:400:kworker.0 00000100:00100000:0.0:1787862300.685435:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862300.685509:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862300.685516:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246430848:0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.685757:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246430464:0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.685805:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862300.685837:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246430976:0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.685862:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862300.685881:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787862300.685887:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246430592:0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.685921:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862300.685938:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246431104:0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.685976:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430464 00000100:00100000:1.0:1787862300.686004:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430464 00000100:00100000:1.0:1787862300.686095:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787862300.686107:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246430464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.686188:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246430464:12345-0@lo:400:kworker.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862300.686197:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787862300.686823:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862300.686922:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862300.686969:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246430464:0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.688516:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430720 00000100:00100000:2.0:1787862300.688539:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430720 00000100:00100000:2.0:1787862300.688639:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430976 00000100:00100000:2.0:1787862300.688643:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430976 00000100:00100000:2.0:1787862300.688665:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430592 00000100:00100000:2.0:1787862300.688668:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430592 00000100:00100000:2.0:1787862300.688691:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787862300.688701:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246430720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.688830:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246430720:12345-0@lo:400:kworker.0 Request processed in 128us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862300.688840:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787862300.688879:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787862300.688886:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246430976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.688943:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246430976:12345-0@lo:400:kworker.0 Request processed in 58us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862300.688950:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787862300.688961:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787862300.688968:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.689001:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246430592:12345-0@lo:400:kworker.0 Request processed in 34us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862300.689008:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787862300.689069:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246430848 00000100:00100000:2.0:1787862300.689073:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246430848 00000100:00100000:2.0:1787862300.689107:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431104 00000100:00100000:2.0:1787862300.689111:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431104 00000100:00100000:2.0:1787862300.689145:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862300.689151:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246430848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.689188:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246430848:12345-0@lo:400:kworker.0 Request processed in 36us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862300.689195:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862300.689207:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862300.689212:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246431104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.689243:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246431104:12345-0@lo:400:kworker.0 Request processed in 31us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862300.689249:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862300.689672:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246430592:0@lo:400:kworker.0 00010000:00080000:2.0:1787862300.689696:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a43c0 x1874709246431104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862300.689774:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246431104:0@lo:400:kworker.0 00000100:00100000:2.0:1787862300.689796:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246430976:0@lo:400:kworker.0 00010000:00080000:1.0:1787862300.690471:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a7840 x1874709246430848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862300.690486:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246430848:0@lo:400:kworker.0 00000100:00100000:1.0:1787862300.690502:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246430720:0@lo:400:kworker.0 00000100:00080000:0.0:1787862300.691299:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862300.691312:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862300.691317:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862300.804521:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862301.188812:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862301.188846:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108677840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246431232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862301.188966:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862301.189080:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431232 00000100:00100000:2.0:1787862301.189090:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431232 00000100:00100000:2.0:1787862301.189151:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787862301.189162:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246431232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862301.189216:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862301.189272:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246431232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862301.189280:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787862301.189332:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108677840 x1874709246431232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862301.189354:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108677840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246431232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862301.829433:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862302.858906:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862303.751146:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246431360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862303.751227:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862303.751317:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431360 00000100:00100000:3.0:1787862303.751326:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431360 00000100:00100000:3.0:1787862303.751398:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787862303.751409:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246431360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862303.751448:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862303.751495:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246431360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862303.751503:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787862303.753056:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862303.753107:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086712c0 x1874709246431360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862303.753135:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246431360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862303.877035:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862304.905932:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862305.109148:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862305.109189:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862305.109216:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862305.109249:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324928 00000100:00100000:0.0:1787862305.109263:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324928 00000100:00100000:0.0:1787862305.109339:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324800 00000100:00100000:0.0:1787862305.109343:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324800 00000100:00100000:1.0:1787862305.109484:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223324672 00000100:00100000:1.0:1787862305.109488:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223324672 00000100:00100000:1.0:1787862305.109584:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 235 00000100:00100000:1.0:1787862305.109594:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223324672:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862305.109667:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223324672:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 74us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862305.109675:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 235 00000100:00100000:0.0:1787862305.111285:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:0.0:1787862305.111296:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223324928:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862305.111373:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223324928:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 78us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862305.111381:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:0.0:1787862305.111396:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00100000:0.0:1787862305.111410:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108672d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223324800:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862305.111433:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108672d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223324800:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862305.111439:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00080000:3.0:1787862305.123021:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862305.796962:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246431744:0@lo:400:kworker.0 00000100:00100000:1.0:1787862305.797105:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862305.797189:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862305.797196:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246431872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862305.797221:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862305.797310:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246431488:0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797357:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862305.797385:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246432000:0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797405:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862305.797426:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862305.797431:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246431616:0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797452:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862305.797490:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246432128:0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797524:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862305.797603:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431872 00000100:00100000:2.0:1787862305.797611:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431872 00000100:00100000:2.0:1787862305.797664:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432128 00000100:00100000:2.0:1787862305.797667:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432128 00000100:00100000:2.0:1787862305.797690:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862305.797698:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246431872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797753:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246431872:12345-0@lo:400:kworker.0 Request processed in 55us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862305.797760:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862305.797778:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862305.797784:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246432128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797816:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246432128:12345-0@lo:400:kworker.0 Request processed in 32us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862305.797823:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862305.797888:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431744 00000100:00100000:2.0:1787862305.797893:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431744 00000100:00100000:2.0:1787862305.797921:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432000 00000100:00100000:2.0:1787862305.797924:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432000 00000100:00100000:2.0:1787862305.797937:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431616 00000100:00100000:2.0:1787862305.797940:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431616 00000100:00100000:2.0:1787862305.797952:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862305.797958:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246431744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.797989:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246431744:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862305.797995:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862305.798005:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787862305.798018:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.798094:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246432000:12345-0@lo:400:kworker.0 Request processed in 77us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862305.798100:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787862305.798112:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862305.798118:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246431616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.798146:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246431616:12345-0@lo:400:kworker.0 Request processed in 28us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862305.798151:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862305.798332:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246431616:0@lo:400:kworker.0 00010000:00080000:2.0:1787862305.798349:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a5a40 x1874709246432128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862305.798361:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246432128:0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.798372:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246432000:0@lo:400:kworker.0 00010000:00080000:2.0:1787862305.798410:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a6580 x1874709246431872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862305.798420:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246431872:0@lo:400:kworker.0 00000100:00100000:2.0:1787862305.798431:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246431744:0@lo:400:kworker.0 00000100:00080000:3.0:1787862305.798714:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862305.798721:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862305.798723:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862305.798899:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246431488 00000100:00100000:1.0:1787862305.798906:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246431488 00000100:00100000:1.0:1787862305.798960:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787862305.798981:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862305.799077:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246431488:12345-0@lo:400:kworker.0 Request processed in 97us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862305.799084:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787862305.799175:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246431488:0@lo:400:kworker.0 00010000:00010000:0.0:1787862305.924477:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862306.308409:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246432256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862306.308487:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862306.308698:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432256 00000100:00100000:2.0:1787862306.308706:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432256 00000100:00100000:2.0:1787862306.308761:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787862306.308770:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246432256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862306.308808:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862306.308901:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246432256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862306.308909:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787862306.308949:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108676580 x1874709246432256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862306.308967:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246432256:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787862306.923881:0:11042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787862306.948220:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862307.984608:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862308.868483:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246432384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862308.868565:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862308.868819:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432384 00000100:00100000:0.0:1787862308.868837:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432384 00000100:00100000:0.0:1787862308.868907:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787862308.868922:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246432384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862308.868962:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862308.869015:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246432384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862308.869023:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787862308.869081:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a4b40 x1874709246432384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862308.869100:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246432384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862308.869308:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862308.999132:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862310.022157:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862310.231805:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862310.232989:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325056 00000100:00100000:1.0:1787862310.233000:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325056 00000100:00100000:1.0:1787862310.233079:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 237 00000100:00100000:1.0:1787862310.233088:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223325056:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862310.233158:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223325056:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 71us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862310.233166:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 237 00000100:00100000:0.0:1787862310.240765:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862310.241747:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325184 00000100:00100000:3.0:1787862310.241759:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325184 00000100:00100000:3.0:1787862310.241849:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:3.0:1787862310.241862:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223325184:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862310.241960:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223325184:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 100us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.241968:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:3.0:1787862310.244236:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862310.244274:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325312 00000100:00100000:3.0:1787862310.244284:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325312 00000100:00100000:3.0:1787862310.244335:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:3.0:1787862310.244346:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223325312:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862310.244649:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223325312:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 304us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.244658:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00080000:0.0:1787862310.245018:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787862310.276584:0:11191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefbd08db0 20000000:00000080:2.0:1787862310.276601:0:11191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a13d78cc00 uarg=0000000000000000 20000000:01000000:2.0:1787862310.276635:0:11191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787862310.276640:0:11191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787862310.276645:0:11191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787862310.277720:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787862310.277951:0:11191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787862310.293743:0:11191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787862310.294015:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294305:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294317:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294326:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294333:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294364:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294372:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294426:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294439:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 12 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.294455:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432512:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862310.294693:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.294703:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 18 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.294713:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432640:0@lo:104: 00000100:00100000:1.0:1787862310.294754:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862310.295185:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.295206:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 18 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.295215:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432768:0@lo:104: 00000100:00100000:1.0:1787862310.295254:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862310.301587:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.301605:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 18 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.301618:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432896:0@lo:104: 00000100:00100000:1.0:1787862310.301686:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862310.303151:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432640 00000100:00100000:0.0:1787862310.303162:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432640 00010000:00010000:1.0:1787862310.303757:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.303774:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 12 pid: 5860 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.303788:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120463c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246433024:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862310.306786:0:11191:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862310.306850:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432512:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862310.306990:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432768 00000100:00100000:3.0:1787862310.306998:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432768 00000100:00100000:3.0:1787862310.307897:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862310.313231:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246432896 00000100:00100000:2.0:1787862310.313247:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246432896 00000100:00100000:2.0:1787862310.313311:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862310.313323:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:11191:x1874709246432640:12345-0@lo:104: 00010000:00010000:2.0:1787862310.313344:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862310.313711:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862310.313722:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:11191:x1874709246432896:12345-0@lo:104: 00010000:00010000:0.0:1787862310.313744:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862310.314919:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862310.314960:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325440 00000100:00100000:3.0:1787862310.314967:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325440 00010000:00010000:3.0:1787862310.315000:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 13 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862310.315025:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325568 00000100:00100000:3.0:1787862310.315028:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325568 00010000:00010000:3.0:1787862310.315074:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 14 pid: 5860 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862310.315114:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1787862310.315123:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+14:2353:x1874709223325440:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862310.315138:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862310.315144:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 14 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.315157:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 14 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.315176:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79ee00/0x391a6cd368cd9bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c051d expref: 14 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.315238:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862310.315287:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223325440:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 164us (7393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.315295:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1787862310.315344:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:3.0:1787862310.315351:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:2353:x1874709223325568:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862310.315359:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862310.315363:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 12 pid: 5860 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.315372:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 12 pid: 5860 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.315382:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862310.315423:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:2353:x1874709223325568:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 71us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.315430:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00010000:00010000:0.0:1787862310.318361:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862310.318380:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:11191:x1874709246432896:12345-0@lo:104: Request processed in 4655us (16689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862310.318392:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862310.318436:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787862310.318446:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:11191:x1874709246432768:12345-0@lo:104: 00010000:00010000:0.0:1787862310.318574:0:5851:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.318728:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432640:0@lo:104: 00010000:00010000:3.0:1787862310.319311:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787862310.319320:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319329:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8200 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862310.319334:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319343:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862310.319351:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862310.319356:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862310.319406:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319684:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862310.319716:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319723:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a8200/0x391a6cd368cd9ba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bac expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319782:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862310.319786:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319830:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862310.319833:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.319840:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862310.319847:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862310.319852:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787862310.319962:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246433152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862310.320031:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862310.320362:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320369:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862310.320382:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320389:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cd9bb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bba expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320399:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862310.320402:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320539:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030e00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862310.320544:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320564:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862310.320571:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862310.320577:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862310.320596:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320603:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862310.320620:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320628:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9bc8 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.320642:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862310.320643:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862310.320646:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862310.320659:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246433280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862310.320691:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862310.320730:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433152 00000100:00100000:3.0:1787862310.320736:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433152 00010000:00010000:3.0:1787862310.320764:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 19 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862310.320790:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433280 00000100:00100000:3.0:1787862310.320793:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433280 00010000:00010000:3.0:1787862310.320827:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 20 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862310.320848:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862310.320856:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3327:x1874709246433152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862310.321373:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862310.321382:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 20 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.321393:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 20 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.321544:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862310.321588:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3327:x1874709246433152:12345-0@lo:103:ldlm_bl.0 Request processed in 733us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.321597:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862310.321619:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862310.321626:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246433280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862310.321636:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862310.321640:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 19 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.321648:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 19 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.321658:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862310.321755:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787862310.321763:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:11191:x1874709246432768:12345-0@lo:104: Request processed in 3319us (26507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862310.321771:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787862310.321791:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862310.323153:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246433280:12345-0@lo:103:ldlm_bl.0 Request processed in 1518us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.323165:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862310.323370:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246433152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862310.323404:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246433408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862310.323513:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862310.323575:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433408 00000100:00100000:3.0:1787862310.323582:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433408 00010000:00010000:3.0:1787862310.323612:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 19 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862310.323634:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862310.323643:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246433408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862310.323655:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862310.323660:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 19 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323672:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 19 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323690:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a8400/0x391a6cd368cd9bc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9bc1 expref: 19 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323708:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323717:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323734:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323741:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323755:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323763:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323769:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862310.323773:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323782:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323793:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.323805:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862310.323852:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:3329:x1874709246433408:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.323859:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862310.324185:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246433408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862310.324925:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787862310.324936:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:11191:x1874709246432640:12345-0@lo:104: Request processed in 11614us (30180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862310.324944:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787862310.325084:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79e000/0x391a6cd368cd9bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9bb3 expref: 17 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.325097:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432768:0@lo:104: 00010000:00010000:1.0:1787862310.325107:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9bac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9ba5 expref: 16 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.325125:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246432896:0@lo:104: 00010000:00010000:1.0:1787862310.325139:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79fe00/0x391a6cd368cd9b9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04e5 expref: 11 pid: 5860 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862310.325147:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120463c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1874709246433024:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862310.325172:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.325180:0:11191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.325187:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862310.325202:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9400/0x391a6cd368cd9bf9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862310.327636:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862310.327715:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246433280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862310.917267:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246433536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862310.917282:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246433664:0@lo:400:kworker.0 00000100:00100000:3.0:1787862310.917309:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246433792:0@lo:400:kworker.0 00000100:00100000:0.0:1787862310.917335:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862310.917369:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862310.917371:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862310.917396:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246434048:0@lo:400:kworker.0 00000100:00100000:0.0:1787862310.917417:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862310.917464:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246433920:0@lo:400:kworker.0 00000100:00100000:1.0:1787862310.917497:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862310.920947:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433536 00000100:00100000:2.0:1787862310.920963:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433536 00000100:00100000:0.0:1787862310.920982:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433664 00000100:00100000:0.0:1787862310.920988:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433664 00000100:00100000:1.0:1787862310.921008:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433920 00000100:00100000:1.0:1787862310.921014:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433920 00000100:00100000:3.0:1787862310.921174:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246433792 00000100:00100000:3.0:1787862310.921180:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246433792 00000100:00100000:3.0:1787862310.921223:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434048 00000100:00100000:0.0:1787862310.921228:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787862310.921229:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434048 00000100:00100000:0.0:1787862310.921238:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862310.921275:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787862310.921285:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246433792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862310.921330:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246433664:12345-0@lo:400:kworker.0 Request processed in 93us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862310.921344:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787862310.921357:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246433792:12345-0@lo:400:kworker.0 Request processed in 72us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862310.921362:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787862310.921374:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787862310.921374:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246433536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862310.921402:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862310.921410:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246433536:12345-0@lo:400:kworker.0 Request processed in 40us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.921416:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246434048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862310.921421:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787862310.921448:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862310.921453:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862310.921456:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862310.921467:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246433664:0@lo:400:kworker.0 00000100:00100000:1.0:1787862310.921623:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787862310.921631:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246433920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862310.921740:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246434048:12345-0@lo:400:kworker.0 Request processed in 330us (4320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862310.921747:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862310.921773:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246433536:0@lo:400:kworker.0 00010000:00080000:2.0:1787862310.921783:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0fe580 x1874709246433792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787862310.921796:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0fe1c0 x1874709246434048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862310.921861:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246433792:0@lo:400:kworker.0 00000100:00100000:1.0:1787862310.921957:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246433920:12345-0@lo:400:kworker.0 Request processed in 327us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862310.921964:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787862310.921993:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246434048:0@lo:400:kworker.0 00000100:00100000:3.0:1787862310.922019:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246433920:0@lo:400:kworker.0 00010000:00010000:3.0:1787862311.045033:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862311.429179:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862311.429214:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108677c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246434176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862311.429294:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862311.429356:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434176 00000100:00100000:2.0:1787862311.429363:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434176 00000100:00100000:2.0:1787862311.429421:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862311.429430:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246434176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862311.429473:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862311.429516:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246434176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862311.429524:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787862311.429563:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108677c00 x1874709246434176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862311.429580:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108677c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246434176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862311.701325:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862311.701394:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325696 00000100:00100000:1.0:1787862311.701418:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325696 00000100:00100000:1.0:1787862311.701489:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 238 00000100:00100000:1.0:1787862311.701510:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:5598:x1874709223325696:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862311.701529:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862311.701550:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0547 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862311.701579:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862311.701594:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862311.701604:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9000, rc 0) 00000100:00100000:1.0:1787862311.701673:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223325696:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 166us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862311.701681:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 238 00000100:00100000:3.0:1787862311.707303:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862311.707485:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325824 00000100:00100000:1.0:1787862311.707499:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325824 00000100:00100000:1.0:1787862311.707565:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 239 00000100:00100000:1.0:1787862311.707577:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223325824:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862311.708424:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223325824:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 843us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862311.708436:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 239 00000100:00100000:3.0:1787862311.711312:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862311.711416:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223325952 00000100:00100000:1.0:1787862311.711428:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223325952 00000100:00100000:1.0:1787862311.711508:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 240 00000100:00100000:1.0:1787862311.711521:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223325952:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862311.711852:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223325952:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 332us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862311.711861:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 240 00000100:00100000:3.0:1787862311.716708:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862311.717008:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326080 00000100:00100000:1.0:1787862311.717022:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326080 00000100:00100000:1.0:1787862311.717253:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 241 00000100:00100000:1.0:1787862311.717267:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223326080:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862311.717291:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862311.717317:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c054e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862311.717356:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862311.717376:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862311.717387:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9600, rc 0) 00000100:00100000:1.0:1787862311.717479:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223326080:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 214us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862311.717487:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 241 00000100:00100000:0.0:1787862311.720475:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862311.720561:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326208 00000100:00100000:3.0:1787862311.720572:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326208 00000100:00100000:3.0:1787862311.720633:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 242 00000100:00100000:3.0:1787862311.720644:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223326208:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862311.721432:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223326208:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 783us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862311.721446:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 242 00000100:00100000:0.0:1787862311.724616:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862311.724878:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326336 00000100:00100000:1.0:1787862311.724891:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326336 00000100:00100000:1.0:1787862311.725003:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 243 00000100:00100000:1.0:1787862311.725013:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223326336:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862311.725317:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223326336:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 304us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862311.725332:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 243 00010000:00010000:0.0:1787862312.068310:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862312.324158:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862312.324166:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102aa4000 from 7 10000000:01000000:2.0:1787862312.324172:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862312.324217:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.324240:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.324253:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862312.324281:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.324345:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862312.324395:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787862312.324496:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434304 00000100:00100000:3.0:1787862312.324504:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434304 00000100:00100000:3.0:1787862312.324548:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787862312.324564:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246434304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862312.324577:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862312.324589:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9c0e expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862312.324614:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862312.324624:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862312.324634:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2ce00, rc 0) 00000100:00100000:3.0:1787862312.324673:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246434304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862312.324680:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787862312.324809:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862312.324824:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.324833:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862312.324883:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.324910:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862312.324934:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862312.324981:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434432 00000100:00100000:0.0:1787862312.324985:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434432 00000100:00100000:0.0:1787862312.325015:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787862312.325022:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246434432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.325295:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246434432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862312.325303:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787862312.325379:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.325409:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.325447:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862312.325478:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862312.325524:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434560 00000100:00100000:0.0:1787862312.325528:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434560 00000100:00100000:0.0:1787862312.325564:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787862312.325571:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246434560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.325702:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246434560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862312.325709:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787862312.325742:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787862312.326758:0:11315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787862312.326901:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787862312.326916:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862312.326924:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.326935:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862312.326943:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862312.326946:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a1102e9000 from 7 10000000:01000000:0.0:1787862312.326948:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862312.326971:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.326977:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.326986:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862312.327002:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.327036:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862312.327101:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11029d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862312.327188:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434688 00000100:00100000:2.0:1787862312.327198:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434688 00000100:00100000:2.0:1787862312.327233:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787862312.327240:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246434688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862312.327249:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862312.327259:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9c1c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.327278:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.327288:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.327295:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e400, rc 0) 00000100:00100000:2.0:1787862312.327324:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246434688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862312.327331:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787862312.327422:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862312.327433:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.327440:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862312.327477:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.327498:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862312.327547:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11029d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862312.329307:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434816 00000100:00100000:3.0:1787862312.329318:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434816 00000100:00100000:3.0:1787862312.329399:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787862312.329409:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246434816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862312.329702:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246434816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862312.329710:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787862312.329784:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.329839:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.329881:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862312.329976:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11029d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862312.330033:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246434944 00000100:00100000:2.0:1787862312.330063:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246434944 00000100:00100000:2.0:1787862312.330084:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787862312.330090:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246434944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.330235:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246434944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862312.330241:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787862312.330308:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246434944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787862312.331119:0:11316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787862312.331273:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787862312.331291:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862312.331300:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.331323:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862312.331333:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862312.331336:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102b43800 from 7 10000000:01000000:2.0:1787862312.331339:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862312.331369:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.331377:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.331387:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862312.331411:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246435072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.331465:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862312.331501:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862312.331548:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435072 00000100:00100000:0.0:1787862312.331556:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435072 00000100:00100000:0.0:1787862312.331585:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787862312.331593:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246435072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862312.331606:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862312.331621:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9c2a expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.331646:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.331662:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862312.331670:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031a00, rc 0) 00000100:00100000:0.0:1787862312.331708:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246435072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862312.331715:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787862312.331784:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246435072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862312.331807:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862312.331816:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862312.331864:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246435200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.331890:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862312.331916:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862312.331956:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435200 00000100:00100000:0.0:1787862312.331960:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435200 00000100:00100000:0.0:1787862312.331975:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787862312.331981:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246435200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862312.332242:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246435200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862312.332249:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787862312.332324:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246435200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.332354:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246435328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862312.332393:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862312.332924:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d12e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787862312.333001:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435328 00000100:00100000:3.0:1787862312.333007:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435328 00000100:00100000:1.0:1787862312.333087:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787862312.333097:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246435328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862312.333257:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246435328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862312.333264:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787862312.339485:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246435328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787862312.340184:0:11317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787862312.340250:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787862312.340270:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862312.340281:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862312.340291:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862313.092374:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862313.825079:0:11388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787862313.989711:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862313.991104:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246435456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862313.991182:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862313.992912:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435456 00000100:00100000:2.0:1787862313.992926:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435456 00000100:00100000:2.0:1787862313.992993:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862313.993004:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246435456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862313.993078:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787862313.993089:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862313.993437:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246435456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 433us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862313.993445:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787862313.995338:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c1a6580 x1874709246435456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862313.995374:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246435456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862314.116259:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862315.140601:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862315.350101:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862315.350191:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862315.350334:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862315.350393:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326464 00000100:00100000:1.0:1787862315.350402:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326464 00000100:00100000:3.0:1787862315.350512:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326592 00000100:00100000:3.0:1787862315.350517:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326592 00000100:00100000:1.0:1787862315.350522:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 253 00000100:00100000:1.0:1787862315.350535:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223326464:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862315.350561:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326720 00000100:00100000:3.0:1787862315.350565:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326720 00000100:00100000:3.0:1787862315.350597:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1787862315.350605:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223326592:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862315.350631:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223326464:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 97us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862315.350639:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 253 00000100:00100000:3.0:1787862315.350645:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223326592:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862315.350654:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1787862315.350670:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:3.0:1787862315.350676:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223326720:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862315.350706:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223326720:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862315.350712:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00080000:3.0:1787862315.350759:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862316.038161:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108677c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246435584:0@lo:400:kworker.0 00000100:00100000:2.0:1787862316.038660:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246435968:0@lo:400:kworker.0 00000100:00100000:2.0:1787862316.038695:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862316.038824:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862316.038866:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435584 00000100:00100000:3.0:1787862316.038873:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435584 00000100:00100000:3.0:1787862316.038918:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787862316.038926:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246435584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862316.039084:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246435712:0@lo:400:kworker.0 00000100:00100000:0.0:1787862316.039118:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862316.039234:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246435840:0@lo:400:kworker.0 00000100:00100000:2.0:1787862316.039442:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435968 00000100:00100000:2.0:1787862316.039447:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435968 00000100:00100000:2.0:1787862316.039534:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787862316.039541:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246435968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862316.039581:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246435968:12345-0@lo:400:kworker.0 Request processed in 40us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862316.039588:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1787862316.039625:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108675a40 x1874709246435968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862316.039639:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246435968:0@lo:400:kworker.0 00000100:00100000:0.0:1787862316.039963:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246436224:0@lo:400:kworker.0 00000100:00100000:0.0:1787862316.040015:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862316.040061:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862316.040069:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246436096:0@lo:400:kworker.0 00000100:00100000:0.0:1787862316.040094:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862316.040123:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436224 00000100:00100000:0.0:1787862316.040127:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436224 00000100:00100000:2.0:1787862316.040183:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862316.040224:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435712 00000100:00100000:2.0:1787862316.040228:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435712 00000100:00100000:2.0:1787862316.040253:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436096 00000100:00100000:2.0:1787862316.040256:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436096 00000100:00080000:1.0:1787862316.040298:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862316.040313:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862316.040315:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862316.040589:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246435584:12345-0@lo:400:kworker.0 Request processed in 1662us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862316.040597:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787862316.040633:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246435840 00000100:00100000:3.0:1787862316.040636:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246435840 00000100:00100000:3.0:1787862316.040671:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787862316.040677:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246435712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862316.040719:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246435712:12345-0@lo:400:kworker.0 Request processed in 41us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862316.040732:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787862316.040745:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787862316.040751:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862316.040796:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246435840:12345-0@lo:400:kworker.0 Request processed in 44us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862316.040802:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787862316.040837:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108677c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246435584:0@lo:400:kworker.0 00000100:00100000:3.0:1787862316.040867:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246435712:0@lo:400:kworker.0 00000100:00100000:3.0:1787862316.040912:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246435840:0@lo:400:kworker.0 00000100:00080000:1.0:1787862316.040984:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862316.041109:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862316.041116:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246436224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862316.041152:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246436224:12345-0@lo:400:kworker.0 Request processed in 36us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862316.041158:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787862316.041288:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a108675680 x1874709246436224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862316.041300:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246436224:0@lo:400:kworker.0 00000100:00100000:2.0:1787862316.041579:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787862316.041586:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862316.041633:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246436096:12345-0@lo:400:kworker.0 Request processed in 48us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862316.041639:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787862316.041743:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246436096:0@lo:400:kworker.0 00010000:00010000:2.0:1787862316.164219:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862316.553382:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246436352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862316.553457:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862316.553570:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436352 00000100:00100000:1.0:1787862316.553578:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436352 00000100:00100000:1.0:1787862316.553632:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862316.553642:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246436352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862316.553679:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862316.553726:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246436352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862316.553734:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787862316.553789:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a120580b40 x1874709246436352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862316.553808:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120580b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246436352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862317.188563:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862318.212574:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862319.026948:0:11488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:25:17 (1787862317) === 00000100:00100000:3.0:1787862319.115621:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862319.115645:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862319.115720:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862319.115801:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436480 00000100:00100000:3.0:1787862319.115810:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436480 00000100:00100000:3.0:1787862319.115868:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787862319.115879:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246436480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862319.115925:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862319.115970:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246436480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862319.115995:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787862319.116018:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862319.116075:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0fc3c0 x1874709246436480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862319.116095:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246436480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862319.241312:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862320.260484:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862320.469439:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862320.469538:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862320.469578:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862320.469627:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326848 00000100:00100000:1.0:1787862320.469638:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326848 00000100:00100000:1.0:1787862320.469701:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 255 00000100:00100000:1.0:1787862320.469722:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223326848:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862320.469807:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223326848:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862320.469832:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 255 00000100:00100000:3.0:1787862320.478826:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223326976 00000100:00100000:3.0:1787862320.478840:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223326976 00000100:00100000:3.0:1787862320.479014:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223327104 00000100:00100000:3.0:1787862320.479018:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223327104 00000100:00100000:2.0:1787862320.479546:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:2.0:1787862320.479559:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223326976:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862320.479634:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223326976:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 78us (10320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862320.479642:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00080000:0.0:1787862320.483874:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862320.486151:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:3.0:1787862320.486166:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223327104:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862320.486254:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223327104:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 92us (16675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862320.486262:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:0.0:1787862321.163069:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246436736:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163153:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862321.163197:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246437248:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163223:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862321.163251:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787862321.163256:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246436608:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163281:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862321.163302:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246437120:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163343:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862321.163370:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246436992:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163395:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862321.163411:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862321.163417:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246436864:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163438:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862321.163466:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436736 00000100:00100000:0.0:1787862321.163474:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436736 00000100:00100000:0.0:1787862321.163523:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437120 00000100:00100000:0.0:1787862321.163526:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437120 00000100:00100000:0.0:1787862321.163549:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436864 00000100:00100000:0.0:1787862321.163552:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436864 00000100:00100000:0.0:1787862321.163567:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787862321.163575:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246436736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163625:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246436736:12345-0@lo:400:kworker.0 Request processed in 49us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.163631:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787862321.163647:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787862321.163653:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a0083892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246437120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163678:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a0083892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246437120:12345-0@lo:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.163684:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787862321.163694:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787862321.163700:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246436864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163742:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246436864:12345-0@lo:400:kworker.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.163756:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1787862321.163774:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862321.163803:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246436864:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163830:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246437120:0@lo:400:kworker.0 00000100:00100000:0.0:1787862321.163839:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246436736:0@lo:400:kworker.0 00000100:00100000:2.0:1787862321.164089:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437248 00000100:00100000:2.0:1787862321.164094:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437248 00000100:00100000:2.0:1787862321.164131:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436992 00000100:00100000:2.0:1787862321.164134:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436992 00000100:00100000:2.0:1787862321.164156:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862321.164163:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246437248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862321.164212:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246437248:12345-0@lo:400:kworker.0 Request processed in 50us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862321.164218:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862321.164238:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787862321.164244:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246436992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862321.164276:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246436992:12345-0@lo:400:kworker.0 Request processed in 31us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862321.164282:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787862321.164319:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4b40 x1874709246436992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862321.164330:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246436992:0@lo:400:kworker.0 00010000:00080000:2.0:1787862321.164353:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a7480 x1874709246437248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862321.164362:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246437248:0@lo:400:kworker.0 00000100:00080000:0.0:1787862321.164415:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862321.164418:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862321.164787:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246436608 00000100:00100000:3.0:1787862321.164792:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246436608 00000100:00100000:3.0:1787862321.164836:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787862321.164844:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246436608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862321.164890:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246436608:12345-0@lo:400:kworker.0 Request processed in 47us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862321.164897:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787862321.165010:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246436608:0@lo:400:kworker.0 00010000:00010000:2.0:1787862321.288518:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862321.339142:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.339180:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223327232 00000100:00100000:0.0:1787862321.339189:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223327232 00000100:00100000:0.0:1787862321.339241:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:0.0:1787862321.339251:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223327232:12345-192.168.202.9@tcp:41:mkdir.0 00000004:00000024:0.0:1787862321.339295:0:5869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787862321.341601:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223327232:12345-192.168.202.9@tcp:41:mkdir.0 Request processed in 2340us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.341617:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862321.351387:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862321.352780:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223327360 00000100:00100000:2.0:1787862321.352793:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223327360 00000100:00100000:2.0:1787862321.352858:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1787862321.352869:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:9783:x1874709223327360:12345-192.168.202.9@tcp:700:mkdir.0 00000100:00100000:2.0:1787862321.354441:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:9783:x1874709223327360:12345-192.168.202.9@tcp:700:mkdir.0 Request processed in 1565us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862321.354464:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1787862321.365424:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862321.365467:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223327616 00000100:00100000:1.0:1787862321.365477:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223327616 00000100:00100000:1.0:1787862321.365533:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1787862321.365542:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:9783:x1874709223327616:12345-192.168.202.9@tcp:36:mkdir.0 00010000:00010000:1.0:1787862321.365615:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862321.367074:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13b211000/0x391a6cd368cd9b19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04d0 expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.367110:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1205e1100) 00010000:00010000:1.0:1787862321.367136:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862321.367558:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.367574:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.367590:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.367603:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.367610:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.367616:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862321.372021:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787862321.372655:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.372671:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.372679:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.372686:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862321.372691:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.372700:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.372729:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:1.0:1787862321.372732:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862321.372738:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.372745:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9c38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862321.372769:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000006d8cd28 reply state 000000006f90d7cb transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862321.372779:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862321.372891:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9783:x1874709223327616:12345-192.168.202.9@tcp:36:mkdir.0 Request processed in 7346us (7474us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787862321.372914:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:3.0:1787862321.375119:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.375136:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.375156:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.375161:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.375166:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.375174:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.375195:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89a104fc5900) 00010000:00010000:3.0:1787862321.375198:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862321.375202:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.375208:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9c3f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862321.385239:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862321.385541:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223327744 00000100:00100000:1.0:1787862321.385551:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223327744 00000100:00100000:1.0:1787862321.385606:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862321.385615:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:9784:x1874709223327744:12345-192.168.202.9@tcp:101:chmod.0 00010000:00010000:1.0:1787862321.385638:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862321.385663:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9c46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0555 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.385741:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9c4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.385756:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.385768:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862321.385833:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787862321.385837:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862321.385882:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.385909:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9c46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0555 expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.385927:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9c4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0555 expref: 7 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.385954:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:1.0:1787862321.385957:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862321.385962:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862321.386021:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9784:x1874709223327744:12345-192.168.202.9@tcp:101:chmod.0 Request processed in 406us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862321.386029:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862321.394256:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.394343:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223328000 00000100:00100000:0.0:1787862321.394361:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223328000 00000100:00100000:0.0:1787862321.394422:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1787862321.394432:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9784:x1874709223328000:12345-192.168.202.9@tcp:36:chmod.0 00010000:00010000:0.0:1787862321.394495:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862321.394524:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9c4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0555 expref: 7 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.394559:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:0.0:1787862321.394570:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862321.394601:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.394615:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.394625:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862321.394964:0:5868:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000393e5705 reply state 0000000039edc051 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862321.394974:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787862321.394987:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787862321.395107:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:9784:x1874709223328000:12345-192.168.202.9@tcp:36:chmod.0 Request processed in 676us (860us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787862321.395116:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00010000:00010000:0.0:1787862321.417508:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.417528:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.417535:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.417541:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.417545:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.417569:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.417590:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862321.417593:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787862321.417597:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.417603:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c54 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862321.441192:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.441296:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223328128 00000100:00100000:0.0:1787862321.441316:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223328128 00000100:00100000:0.0:1787862321.441392:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1787862321.441403:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9785:x1874709223328128:12345-192.168.202.9@tcp:101:chown.0 00010000:00010000:0.0:1787862321.441427:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862321.441451:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c055c expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.441519:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9c62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.441535:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.441553:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862321.441615:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787862321.441620:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862321.441731:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.441762:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c055c expref: 9 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.441783:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c055c expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.441791:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862321.441795:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862321.441799:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031600, rc 0) 00000100:00100000:0.0:1787862321.441868:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:9785:x1874709223328128:12345-192.168.202.9@tcp:101:chown.0 Request processed in 466us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.441876:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1787862321.446734:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862321.446814:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223328256 00000100:00100000:3.0:1787862321.446823:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223328256 00000100:00100000:3.0:1787862321.446886:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:3.0:1787862321.447139:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:9785:x1874709223328256:12345-192.168.202.9@tcp:101:chown.0 00010000:00010000:3.0:1787862321.447164:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862321.447190:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9c69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0563 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447257:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447290:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447302:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447334:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447343:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447351:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447461:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cd9c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447471:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cd9c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447479:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cd9c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862321.447519:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787862321.447522:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862321.447551:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cd9c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447563:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447580:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447588:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447594:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.447598:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447606:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447619:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862321.447621:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862321.447626:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447633:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447646:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447652:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447658:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447662:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.447670:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447677:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447685:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89a108824200) 00010000:00010000:3.0:1787862321.447688:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862321.447690:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447696:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447741:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0563 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447755:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cd9c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0563 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.447762:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a108824800) 00010000:00010000:3.0:1787862321.447764:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862321.447767:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2dc00, rc 0) 00000100:00100000:3.0:1787862321.447834:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:9785:x1874709223328256:12345-192.168.202.9@tcp:101:chown.0 Request processed in 939us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862321.447842:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:3.0:1787862321.453720:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.453817:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223328512 00000100:00100000:0.0:1787862321.453826:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223328512 00000100:00100000:0.0:1787862321.453890:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1787862321.453900:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:9785:x1874709223328512:12345-192.168.202.9@tcp:36:chown.0 00010000:00010000:0.0:1787862321.453954:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862321.453980:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cd9c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0563 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.454000:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a108824800) 00010000:00010000:0.0:1787862321.454012:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862321.454091:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.454136:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.454147:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862321.504457:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787862321.504661:0:5869:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f57e266f reply state 000000008f6f4411 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862321.504677:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787862321.504900:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787862321.505073:0:5869:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787862321.505108:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9785:x1874709223328512:12345-192.168.202.9@tcp:36:chown.0 Request processed in 51192us (51390us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787862321.505118:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00010000:00010000:2.0:1787862321.505160:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.505170:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.505178:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.505185:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862321.505189:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.505198:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.505216:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882400) 00010000:00010000:2.0:1787862321.505220:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787862321.505225:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.505231:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862321.561201:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.561561:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223328640 00000100:00100000:0.0:1787862321.561569:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223328640 00000100:00100000:0.0:1787862321.561623:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1787862321.561634:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:9786:x1874709223328640:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1787862321.561667:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862321.561689:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c056a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787862321.566820:0:5868:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5045us 00010000:00010000:0.0:1787862321.587640:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.587818:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.587831:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.587847:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.587855:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.587872:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593086:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cd9ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593107:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cd9ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593117:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cd9ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862321.593182:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787862321.593185:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862321.593251:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cd9ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593262:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593266:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593271:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593275:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.593277:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593282:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593297:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862321.593299:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.593303:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593308:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593317:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593321:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593324:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593327:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.593329:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593332:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593336:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89a116882200) 00010000:00010000:0.0:1787862321.593337:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.593339:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593342:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9c9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593378:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c056a expref: 8 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593388:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cd9ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c056a expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.593393:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:0.0:1787862321.593394:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787862321.593395:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8800, rc 0) 00000100:00100000:0.0:1787862321.593777:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9786:x1874709223328640:12345-192.168.202.9@tcp:101:touch.500 Request processed in 31826us (32268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.593790:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1787862321.613165:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862321.613251:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223328896 00000100:00100000:2.0:1787862321.613262:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223328896 00000100:00100000:2.0:1787862321.613321:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:2.0:1787862321.613331:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:9786:x1874709223328896:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1787862321.613363:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862321.613384:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ca8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0571 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.613737:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.613753:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.613767:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.613784:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.613792:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.613799:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862321.614721:0:9468:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787862321.614991:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615004:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615013:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615087:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615095:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615101:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615107:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862321.615112:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615119:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615132:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:2.0:1787862321.615135:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862321.615140:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615147:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cd9caf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862321.615159:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d645440e reply state 0000000040c12d62 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862321.615168:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787862321.615203:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ca8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0571 expref: 10 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615231:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0571 expref: 9 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.615238:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a1205e1300) 00010000:00010000:2.0:1787862321.615241:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862321.615243:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79ec00, rc 0) 00000100:00100000:2.0:1787862321.615317:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:9786:x1874709223328896:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1987us (2164us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787862321.615326:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00010000:00010000:3.0:1787862321.621459:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.621493:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.621500:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.621506:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.621512:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.621597:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.621615:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff89a1205e1400) 00010000:00010000:3.0:1787862321.621618:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862321.621622:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.621629:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cd9cb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862321.629688:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862321.629804:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223329152 00000100:00100000:2.0:1787862321.629815:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223329152 00000100:00100000:2.0:1787862321.629878:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1787862321.629889:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:9786:x1874709223329152:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1787862321.629952:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862321.629981:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9cbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0571 expref: 9 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.629999:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a1205e1300) 00010000:00010000:2.0:1787862321.630011:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862321.630082:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.630096:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.630106:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862321.630305:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000338d4bf7 reply state 0000000096158db7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862321.630316:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862321.630409:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:9786:x1874709223329152:12345-192.168.202.9@tcp:36:touch.500 Request processed in 521us (730us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787862321.630416:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1787862321.637980:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1787862321.641673:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.641694:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.641711:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.641718:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.641723:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.641732:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.641752:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:0.0:1787862321.641780:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.641786:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.641794:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ccb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862321.643141:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223329280 00000100:00100000:1.0:1787862321.643157:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223329280 00000100:00100000:1.0:1787862321.643235:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1787862321.643245:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:9786:x1874709223329280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1787862321.643275:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862321.643299:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9cd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0578 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.643362:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0578 expref: 10 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.643377:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0578 expref: 10 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862321.643395:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:1.0:1787862321.643409:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862321.643414:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9a00, rc 0) 00000100:00100000:1.0:1787862321.643523:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:9786:x1874709223329280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 278us (5552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862321.643530:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1787862321.650630:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862321.651756:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223329408 00000100:00100000:2.0:1787862321.651768:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223329408 00000100:00100000:2.0:1787862321.651849:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1787862321.651856:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874709223329408:12345-192.168.202.9@tcp:8:touch.500 00010000:00080000:2.0:1787862321.651888:0:6711:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:2.0:1787862321.651915:0:6711:0:(genops.c:1385:class_connect()) connect: client c20d7abe-3b31-4da4-909a-c5bb95bfc247, cookie 0x391a6cd368cd9cd9 00002000:00100000:2.0:1787862321.651925:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c20d7abe-3b31-4da4-909a-c5bb95bfc247/ffff89a006606800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787862321.651945:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787862321.652167:0:6711:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787862321.652198:0:6711:0:(import.c:65:import_set_state_nolock()) ffff89a006607800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862321.652269:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2351:x1874709223329408:12345-192.168.202.9@tcp:8:touch.500 Request processed in 412us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862321.652275:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1787862321.665169:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862321.665669:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223329536 00000100:00100000:2.0:1787862321.665680:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223329536 00000100:00100000:2.0:1787862321.665769:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:2.0:1787862321.665779:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:0:x1874709223329536:12345-192.168.202.9@tcp:2:touch.500 00000100:00080000:0.0:1787862321.666229:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862321.669608:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862321.669631:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246437376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862321.669696:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862321.670062:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437376 00000100:00100000:3.0:1787862321.670078:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437376 00000100:00100000:3.0:1787862321.670126:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787862321.670135:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246437376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862321.670168:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862321.670223:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246437376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862321.670231:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787862321.670300:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d3f21c0 x1874709246437376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862321.670319:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246437376:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787862321.752597:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787862321.752608:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000100:00100000:3.0:1787862321.752911:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:0:x1874709223329536:12345-192.168.202.9@tcp:2:touch.500 Request processed in 87125us (87746us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787862321.752922:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:1.0:1787862321.756335:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862321.756539:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223329792 00000100:00100000:3.0:1787862321.756549:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223329792 00000100:00100000:3.0:1787862321.756643:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1787862321.756662:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:9786:x1874709223329792:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1787862321.757069:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:9786:x1874709223329792:12345-192.168.202.9@tcp:35:touch.500 Request processed in 409us (744us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787862321.757074:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1787862321.770928:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862321.771012:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223329920 00000100:00100000:3.0:1787862321.771022:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223329920 00000100:00100000:3.0:1787862321.771103:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1787862321.771114:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:9787:x1874709223329920:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:3.0:1787862321.771142:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862321.771187:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c057f expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.771254:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9ce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.771265:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.771274:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862321.771322:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862321.771324:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862321.771368:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.771391:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c057f expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.771407:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c057f expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.771636:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:3.0:1787862321.771639:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862321.771643:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862321.771724:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:9787:x1874709223329920:12345-192.168.202.9@tcp:101:rm.0 Request processed in 611us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862321.771732:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1787862321.782847:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.782921:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223330176 00000100:00100000:0.0:1787862321.782930:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223330176 00000100:00100000:0.0:1787862321.782975:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1787862321.782982:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:9787:x1874709223330176:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:0.0:1787862321.782999:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862321.783015:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0586 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862321.783144:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787862321.783300:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9cee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0586 expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.783311:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862321.783313:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862321.783317:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0586 expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.783327:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9800, rc 0) 00000100:00100000:0.0:1787862321.783382:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:9787:x1874709223330176:12345-192.168.202.9@tcp:101:rm.0 Request processed in 401us (545us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787862321.783388:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:1.0:1787862321.788128:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.788298:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223330304 00000100:00100000:0.0:1787862321.788308:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223330304 00000100:00100000:0.0:1787862321.788370:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:0.0:1787862321.788380:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:9787:x1874709223330304:12345-192.168.202.9@tcp:37:rm.0 00000100:00100000:0.0:1787862321.796820:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:9787:x1874709223330304:12345-192.168.202.9@tcp:37:rm.0 Request processed in 8427us (8687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.796836:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:1.0:1787862321.800438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862321.800608:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223330560 00000100:00100000:3.0:1787862321.800632:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223330560 00000100:00100000:3.0:1787862321.800691:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1787862321.800709:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:9787:x1874709223330560:12345-192.168.202.9@tcp:35:rm.0 00000100:00100000:3.0:1787862321.800936:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:9787:x1874709223330560:12345-192.168.202.9@tcp:35:rm.0 Request processed in 237us (506us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787862321.800942:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1787862321.803473:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.803559:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223330816 00000100:00100000:0.0:1787862321.803570:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223330816 00000100:00100000:0.0:1787862321.803629:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:0.0:1787862321.803639:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:9787:x1874709223330816:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:0.0:1787862321.803663:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862321.803686:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9cfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c058d expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.803819:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9d03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.803832:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.803840:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862321.803850:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787862321.803976:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9cfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c058d expref: 17 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.803990:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9d03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c058d expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.803996:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:0.0:1787862321.803998:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862321.804000:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8e00, rc 0) 00000100:00100000:0.0:1787862321.804098:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223330816:12345-192.168.202.9@tcp:101:rm.0 Request processed in 461us (636us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787862321.804106:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:1.0:1787862321.806958:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.807246:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223330944 00000100:00100000:0.0:1787862321.807257:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223330944 00000100:00100000:0.0:1787862321.807324:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:0.0:1787862321.807334:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223330944:12345-192.168.202.9@tcp:41:rm.0 00000004:00000024:0.0:1787862321.807574:0:5869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787862321.807682:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223330944:12345-192.168.202.9@tcp:41:rm.0 Request processed in 348us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.807690:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:1.0:1787862321.811145:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.811280:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223331072 00000100:00100000:0.0:1787862321.811290:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223331072 00000100:00100000:0.0:1787862321.811339:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1787862321.811346:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223331072:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:0.0:1787862321.811372:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862321.811390:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cd9d11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0594 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811476:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811492:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811505:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811519:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811525:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811531:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811634:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811640:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811645:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862321.811667:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787862321.811670:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862321.811683:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811709:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811718:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811725:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811735:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811741:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.811745:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811753:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811764:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:0.0:1787862321.811767:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.811772:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811779:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cd9d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811794:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811800:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811811:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811816:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.811818:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811824:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811832:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff89a116882900) 00010000:00010000:0.0:1787862321.811835:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.811837:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811841:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cd9d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811866:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cd9d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0594 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811876:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0594 expref: 17 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.811880:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:0.0:1787862321.811882:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862321.811883:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9c00, rc 0) 00000100:00100000:0.0:1787862321.812207:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:9787:x1874709223331072:12345-192.168.202.9@tcp:101:rm.0 Request processed in 858us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862321.812220:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:2.0:1787862321.814605:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862321.814649:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223331328 00000100:00100000:0.0:1787862321.814658:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223331328 00000100:00100000:0.0:1787862321.814764:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:0.0:1787862321.814772:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:9787:x1874709223331328:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:0.0:1787862321.814817:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787862321.814839:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cd9d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0594 expref: 17 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814853:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9cd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0578 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814861:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:0.0:1787862321.814871:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cd9ce7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c057f expref: 15 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814877:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:0.0:1787862321.814879:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862321.814894:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814903:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814910:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814929:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814944:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.814949:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815107:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815113:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815118:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862321.815769:0:9468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787862321.815778:0:9468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372850736680ns, next at 373850735210ns, rc = 0 00010000:00010000:0.0:1787862321.815821:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815827:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815832:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815837:0:9468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815840:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815851:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815868:0:9468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862321.815888:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815894:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815901:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815906:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862321.815909:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862321.815911:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815915:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815919:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815929:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a116882800) 00010000:00010000:0.0:1787862321.815931:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787862321.815934:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815936:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862321.815939:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815941:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9d3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815946:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815954:0:8521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89a116882800) 00010000:00010000:2.0:1787862321.815956:0:8521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787862321.815956:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815959:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815963:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815965:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160000/0x391a6cd368cd9d42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815973:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862321.815979:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862321.815979:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862321.815980:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862321.815982:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862321.815982:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815987:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.815994:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:0.0:1787862321.815997:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.816000:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.816005:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cd9d2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862321.816013:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000042a67e8e reply state 000000002c28fd4c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862321.816020:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862321.816122:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223331328:12345-192.168.202.9@tcp:36:rm.0 Request processed in 1348us (1524us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787862321.816128:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00010000:00010000:3.0:1787862321.817822:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.817838:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.817846:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.817853:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.817858:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.817866:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.817883:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff89a116882200) 00010000:00010000:3.0:1787862321.817887:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862321.817892:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.817899:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cd9d34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862321.819412:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862321.819641:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223331584 00000100:00100000:3.0:1787862321.819662:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223331584 00000100:00100000:3.0:1787862321.819755:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1787862321.819764:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:9787:x1874709223331584:12345-192.168.202.9@tcp:35:rm.0 00000100:00100000:3.0:1787862321.820003:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223331584:12345-192.168.202.9@tcp:35:rm.0 Request processed in 240us (599us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787862321.820008:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1787862321.824998:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862321.825034:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223331840 00000100:00100000:3.0:1787862321.825081:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223331840 00000100:00100000:3.0:1787862321.825154:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1787862321.825165:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:9787:x1874709223331840:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:3.0:1787862321.825225:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787862321.825252:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cd9d03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c058d expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825276:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cd9ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c056a expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825287:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a116882d00) 00010000:00010000:3.0:1787862321.825301:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9c62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c055c expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825307:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862321.825312:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862321.825331:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825341:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825364:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825379:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825386:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825393:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825895:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825905:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.825912:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862321.827007:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787862321.827024:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827031:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827036:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827108:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.827120:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827128:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827197:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89a108824e00) 00010000:00010000:3.0:1787862321.827200:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787862321.827204:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827209:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9d57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827225:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827229:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827233:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827236:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862321.827237:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827241:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827245:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824200) 00010000:00010000:3.0:1787862321.827246:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862321.827253:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862321.827256:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d400/0x391a6cd368cd9d49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862321.827264:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a7e826db reply state 00000000b3d60874 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862321.827269:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862321.827347:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:9787:x1874709223331840:12345-192.168.202.9@tcp:36:rm.0 Request processed in 2181us (2357us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787862321.827356:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00010000:00010000:0.0:1787862321.828882:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.828893:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.828908:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.828920:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862321.828923:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.828928:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.828940:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89a108824b00) 00010000:00010000:0.0:1787862321.828942:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862321.828944:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862321.828948:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9d50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862322.310170:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862323.335036:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862324.237405:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246437504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862324.237528:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862324.237641:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437504 00000100:00100000:1.0:1787862324.237654:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437504 00000100:00100000:1.0:1787862324.237748:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787862324.237760:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246437504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862324.237811:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862324.237867:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246437504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862324.237876:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787862324.237902:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787862324.237945:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c0a4b40 x1874709246437504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862324.237991:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246437504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862324.358987:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862325.384207:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862325.589860:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862325.589917:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862325.589955:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862325.589990:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862325.590116:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332224 00000100:00100000:0.0:1787862325.590131:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332224 00000100:00100000:0.0:1787862325.590226:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:0.0:1787862325.590240:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223332224:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862325.590347:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223332224:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 110us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862325.590356:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:0.0:1787862325.590385:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332096 00000100:00100000:0.0:1787862325.590389:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332096 00000100:00100000:0.0:1787862325.590438:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332352 00000100:00100000:0.0:1787862325.590441:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332352 00000100:00100000:0.0:1787862325.590462:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:0.0:1787862325.590469:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:2353:x1874709223332096:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862325.590509:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:2353:x1874709223332096:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862325.590516:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:0.0:1787862325.590528:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:0.0:1787862325.590534:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223332352:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862325.590558:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223332352:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862325.590565:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:2.0:1787862325.590816:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223331968 00000100:00100000:2.0:1787862325.590822:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223331968 00000100:00100000:2.0:1787862325.590866:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 257 00000100:00100000:2.0:1787862325.590874:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223331968:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862325.590903:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223331968:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 30us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862325.590910:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 257 00000100:00080000:3.0:1787862325.591483:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862325.591491:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862326.278354:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246437760:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.278465:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862326.278529:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246438272:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.278558:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862326.278594:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862326.278601:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246437632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.278630:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862326.278653:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246438144:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.278688:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862326.278715:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246437888:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.278741:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862326.278759:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862326.278763:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246438016:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.278784:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862326.278817:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437760 00000100:00100000:2.0:1787862326.278826:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437760 00000100:00100000:2.0:1787862326.278882:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438144 00000100:00100000:2.0:1787862326.278886:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438144 00000100:00100000:2.0:1787862326.278911:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437888 00000100:00100000:2.0:1787862326.278913:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437888 00000100:00100000:2.0:1787862326.278930:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787862326.278940:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246437760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279002:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246437760:12345-0@lo:400:kworker.0 Request processed in 62us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862326.279010:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787862326.279028:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787862326.279034:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246438144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279106:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246438144:12345-0@lo:400:kworker.0 Request processed in 70us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862326.279112:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787862326.279124:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787862326.279129:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246437888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279162:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246437888:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862326.279168:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787862326.279189:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438272 00000100:00100000:2.0:1787862326.279193:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438272 00000100:00100000:2.0:1787862326.279221:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438016 00000100:00100000:2.0:1787862326.279224:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438016 00000100:00100000:2.0:1787862326.279244:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862326.279250:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246438272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279280:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246438272:12345-0@lo:400:kworker.0 Request processed in 31us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862326.279286:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862326.279297:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862326.279302:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246438016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279345:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246438016:12345-0@lo:400:kworker.0 Request processed in 42us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862326.279351:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862326.279370:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246437632 00000100:00100000:2.0:1787862326.279374:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246437632 00000100:00100000:2.0:1787862326.279400:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787862326.279407:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246437632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279446:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246437632:12345-0@lo:400:kworker.0 Request processed in 40us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862326.279453:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:2.0:1787862326.279495:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862326.279500:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862326.279503:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787862326.279544:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a1086712c0 x1874709246438016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862326.279561:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246438016:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279573:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246437888:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279610:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246437632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279620:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246438144:0@lo:400:kworker.0 00000100:00100000:2.0:1787862326.279629:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246437760:0@lo:400:kworker.0 00010000:00080000:2.0:1787862326.279639:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a10871c3c0 x1874709246438272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862326.279648:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246438272:0@lo:400:kworker.0 00010000:00010000:2.0:1787862326.407180:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787862326.457610:0:11687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1787862326.789296:0:8122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377824251169ns, next at 378824248034ns, rc = 0 00000100:00100000:3.0:1787862326.789407:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862326.789435:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246438400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862326.789533:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862326.789622:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438400 00000100:00100000:0.0:1787862326.789632:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438400 00000100:00100000:0.0:1787862326.789706:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787862326.789718:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246438400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862326.789771:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862326.789843:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246438400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862326.789851:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787862326.789906:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0ff0c0 x1874709246438400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862326.789926:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246438400:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787862326.882188:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787862326.882208:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787862326.882259:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1787862326.882637:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246438528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787862326.882751:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862326.882860:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438528 00000100:00100000:1.0:1787862326.882868:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438528 00000100:00100000:1.0:1787862326.882926:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862326.882937:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246438528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787862326.882975:0:6712:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787862326.883022:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a909d31, atime: 0x6a909d31, ctime: 0x6a909d31, blocks: 0x1 00010000:00010000:1.0:1787862326.883032:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862326.883087:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787862326.883092:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862326.883100:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862326.883122:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862326.883135:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862326.883145:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862326.883184:0:6712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787862326.883856:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3328:x1874709246438528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 917us (1103us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787862326.883867:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787862326.884394:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862326.884405:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862326.884428:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862326.884433:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862326.884443:0:3328:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13c0a5680/2, rc 0, transno 4294967300 00010000:00010000:0.0:1787862326.884446:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862326.884455:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246438528:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787862326.884475:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862326.884486:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000984977f7/0x391a6cd368cd9d5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862326.884511:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862326.884513:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862326.884514:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862327.430302:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787862327.730989:0:11736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7e655e50 20000000:00000080:1.0:1787862327.731014:0:11736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a13cb56000 uarg=0000000000000000 20000000:01000000:0.0:1787862327.731542:0:11736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787862327.731553:0:11736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787862327.731559:0:11736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787862327.732762:0:11737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787862327.733024:0:11736:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787862327.738748:0:11736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787862327.738818:0:11736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787862327.738874:0:11736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787862327.738899:0:11736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787862327.738924:0:11736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.738966:0:11736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.738975:0:11736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.738986:0:11736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.738993:0:11736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739001:0:11736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739011:0:11736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739095:0:11736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739113:0:11736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 18 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.739132:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246438656:0@lo:104: 00000100:00100000:0.0:1787862327.739226:0:11736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862327.739300:0:11736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739309:0:11736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 18 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.739325:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246438784:0@lo:104: 00000100:00100000:0.0:1787862327.739348:0:11736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862327.739372:0:11736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739381:0:11736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 18 pid: 5860 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.739389:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246438912:0@lo:104: 00000100:00100000:0.0:1787862327.739413:0:11736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862327.739435:0:11736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739447:0:11736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 12 pid: 5862 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.739458:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246439040:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862327.739538:0:11736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.739546:0:11736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 12 pid: 5863 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.739553:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246439168:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862327.739576:0:11736:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13cf4e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862327.739790:0:7650:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787862327.739806:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438656 00000100:00100000:1.0:1787862327.739814:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438656 00000100:00100000:1.0:1787862327.739860:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438784 00000100:00100000:1.0:1787862327.739863:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438784 00000100:00100000:1.0:1787862327.739872:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246438912 00000100:00100000:1.0:1787862327.739874:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246438912 00000100:00100000:1.0:1787862327.739887:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862327.739898:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:11736:x1874709246438656:12345-0@lo:104: 00010000:00010000:1.0:1787862327.739915:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.739992:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862327.739999:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+5:11736:x1874709246438656:12345-0@lo:104: Request processed in 102us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862327.740007:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862327.740029:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862327.740035:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:11736:x1874709246438784:12345-0@lo:104: 00010000:00010000:1.0:1787862327.740063:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740115:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787862327.740122:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+4:11736:x1874709246438784:12345-0@lo:104: Request processed in 87us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862327.740129:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862327.740140:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862327.740146:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005459850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:11736:x1874709246438912:12345-0@lo:104: 00010000:00010000:1.0:1787862327.740154:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740184:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787862327.740188:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005459850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+3:11736:x1874709246438912:12345-0@lo:104: Request processed in 43us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862327.740195:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787862327.740352:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787862327.740361:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740370:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f600 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862327.740374:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740386:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862327.740396:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862327.740402:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787862327.740443:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740450:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862327.740478:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740485:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13d79f600/0x391a6cd368cd9c2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c31 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740501:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862327.740504:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740510:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030e00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862327.740514:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740521:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862327.740533:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862327.740539:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787862327.740552:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740558:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862327.740564:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740581:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030e00/0x391a6cd368cd9c1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c23 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740591:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862327.740594:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740600:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862327.740603:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740612:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862327.740619:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862327.740625:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787862327.740638:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740655:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862327.740672:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740679:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13d79f000/0x391a6cd368cd9c0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cd9c15 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862327.740694:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862327.740701:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862327.740703:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862327.740719:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246439296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862327.740757:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862327.740793:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862327.740799:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246439424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862327.740822:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862327.741086:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862327.741109:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246439296 00000100:00100000:3.0:1787862327.741116:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246439296 00010000:00010000:3.0:1787862327.741145:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 19 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862327.741192:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246439424 00000100:00100000:3.0:1787862327.741196:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246439424 00010000:00010000:3.0:1787862327.741208:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 20 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862327.741228:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862327.741234:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3329:x1874709246439296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862327.741247:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862327.741253:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 20 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.741267:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 20 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.741285:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862327.741330:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3329:x1874709246439296:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862327.741337:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862327.741351:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862327.741357:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246439424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862327.741366:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862327.741370:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 19 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.741379:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 19 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.741390:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862327.741415:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246439424:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862327.741421:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862327.741466:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246439424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862327.741476:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246439296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862327.741525:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862327.741710:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246439552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862327.741746:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862327.741773:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246439552 00000100:00100000:3.0:1787862327.741777:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246439552 00010000:00010000:3.0:1787862327.741791:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 19 pid: 5860 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862327.741811:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862327.741817:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246439552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862327.741824:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862327.741828:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 19 pid: 5860 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.741838:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 19 pid: 5860 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.741848:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862327.741872:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246439552:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862327.741878:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862327.741931:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246439552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862327.742784:0:11736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100031a00/0x391a6cd368cd9c31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9c2a expref: 18 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.742818:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246438656:0@lo:104: 00010000:00010000:0.0:1787862327.742832:0:11736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79e400/0x391a6cd368cd9c23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9c1c expref: 17 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.742840:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246438784:0@lo:104: 00010000:00010000:0.0:1787862327.742849:0:11736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2ce00/0x391a6cd368cd9c15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cd9c0e expref: 16 pid: 5860 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.742857:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246438912:0@lo:104: 00000100:00100000:3.0:1787862327.752686:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862327.752732:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862327.752837:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332608 00000100:00100000:2.0:1787862327.752851:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332608 00010000:00010000:2.0:1787862327.752913:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 13 pid: 5863 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862327.752960:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332480 00000100:00100000:2.0:1787862327.752964:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332480 00010000:00010000:2.0:1787862327.752978:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 14 pid: 5862 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862327.752983:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:3.0:1787862327.753002:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+14:2352:x1874709223332608:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787862327.753011:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:2.0:1787862327.753022:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+14:2352:x1874709223332480:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862327.753024:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862327.753034:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862327.753204:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 14 pid: 5863 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.757502:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 14 pid: 5863 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.757511:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 14 pid: 5862 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.757670:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246439040:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862327.757794:0:11736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9000/0x391a6cd368cd9c00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0547 expref: 14 pid: 5863 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862327.757815:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11736:1874709246439168:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862327.762463:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 13 pid: 5862 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862327.762495:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862327.762513:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9600/0x391a6cd368cd9c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c054e expref: 13 pid: 5862 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.762537:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.762548:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.762573:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.762605:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.762614:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862327.762622:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:2352:x1874709223332608:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 9620us (9947us total) trans 0 rc 0/0 00010000:00010000:2.0:1787862327.762625:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.762639:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160000 already unused, calling callback (ffffffffc15f5540) 00000100:00100000:3.0:1787862327.762654:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00010000:00010000:2.0:1787862327.765154:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.765248:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.765272:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862327.765362:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862327.765465:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:2352:x1874709223332480:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 12437us (12724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862327.765479:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00010000:00010000:0.0:1787862327.765618:0:11736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.765632:0:11736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.765639:0:11736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862327.765659:0:11736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d65 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862328.452330:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862329.349622:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862329.349680:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246439680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862329.349798:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.350108:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246439680 00000100:00100000:0.0:1787862329.350137:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246439680 00000100:00080000:2.0:1787862329.350173:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862329.350214:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787862329.350225:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246439680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862329.350289:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862329.350358:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246439680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.350366:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787862329.350520:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35c780 x1874709246439680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862329.350549:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246439680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862329.427878:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862329.428269:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332736 00000100:00100000:0.0:1787862329.428282:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332736 00000100:00100000:0.0:1787862329.428416:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 259 00000100:00100000:0.0:1787862329.428427:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:5598:x1874709223332736:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862329.428450:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862329.428477:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c059b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.428513:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c059b expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.428526:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c059b expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.428537:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160000, rc 0) 00000100:00100000:0.0:1787862329.428693:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223332736:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 266us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.428700:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 259 00000100:00100000:2.0:1787862329.438564:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862329.441190:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332864 00000100:00100000:0.0:1787862329.441213:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332864 00000100:00100000:0.0:1787862329.442094:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 260 00000100:00100000:0.0:1787862329.442132:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223332864:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.442595:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223332864:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 466us (4052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.442605:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 260 00000100:00100000:1.0:1787862329.447800:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862329.452073:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223332992 00000100:00100000:0.0:1787862329.452094:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223332992 00000100:00100000:0.0:1787862329.452194:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 261 00000100:00100000:0.0:1787862329.452206:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223332992:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.452543:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223332992:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 338us (4757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.452552:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 261 00000100:00100000:1.0:1787862329.455286:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862329.455682:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333120 00000100:00100000:0.0:1787862329.455695:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333120 00000100:00100000:0.0:1787862329.455768:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 262 00000100:00100000:0.0:1787862329.455780:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:10058:x1874709223333120:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862329.456459:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:10058:x1874709223333120:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 675us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.456471:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 262 00000100:00100000:1.0:1787862329.472597:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862329.472727:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333248 00000100:00100000:3.0:1787862329.472740:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333248 00000100:00100000:3.0:1787862329.472814:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 263 00000100:00100000:3.0:1787862329.472825:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:10058:x1874709223333248:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862329.473568:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:10058:x1874709223333248:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 740us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862329.473578:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 263 10000000:01000000:0.0:1787862329.477537:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862329.477549:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102aa4000 from 7 10000000:01000000:0.0:1787862329.477557:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862329.477643:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.477661:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.477714:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862329.477752:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246439808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.477867:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.477934:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13cf4e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862329.477967:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246439808 00000100:00100000:0.0:1787862329.477976:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246439808 00000100:00100000:0.0:1787862329.478082:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787862329.478097:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:5865:x1874709246439808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862329.478117:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862329.478136:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a142160800/0x391a6cd368cd9d7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9d73 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.478167:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a142160800/0x391a6cd368cd9d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9d73 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.478180:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a142160800/0x391a6cd368cd9d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9d73 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.478190:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160800, rc 0) 00000100:00100000:0.0:1787862329.478237:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246439808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.478244:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787862329.478329:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246439808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862329.478345:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.478364:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862329.478432:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246439936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.478459:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.478476:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13cf4e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862329.478602:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246439936 00000100:00100000:3.0:1787862329.478608:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246439936 00000100:00100000:3.0:1787862329.478650:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787862329.478657:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246439936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862329.479013:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246439936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 355us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862329.479020:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787862329.479328:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246439936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.479366:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.479417:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.479455:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13cf4e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862329.486161:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440064 00000100:00100000:3.0:1787862329.486184:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440064 00000100:00100000:3.0:1787862329.486473:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787862329.486488:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246440064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862329.487347:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246440064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 858us (7924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862329.487358:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787862329.487385:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862329.488083:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862329.488362:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333376 00000100:00100000:0.0:1787862329.488370:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333376 00000100:00100000:0.0:1787862329.488421:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 267 00000100:00100000:0.0:1787862329.488431:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:5598:x1874709223333376:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862329.488446:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862329.488470:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a142161e00/0x391a6cd368cd9d81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05a2 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.488503:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a142161e00/0x391a6cd368cd9d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05a2 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.488516:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a142161e00/0x391a6cd368cd9d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05a2 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.488541:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142161e00, rc 0) 00000100:00100000:0.0:1787862329.488605:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223333376:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 175us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.488612:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 267 00000100:00100000:3.0:1787862329.488616:0:11749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11749:1874709246440192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862329.488684:0:11749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862329.488732:0:11749:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787862329.488837:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862329.489300:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440192 00000100:00100000:2.0:1787862329.489306:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440192 00000100:00100000:2.0:1787862329.489352:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787862329.489361:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:11749:x1874709246440192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862329.489619:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:11749:x1874709246440192:12345-0@lo:502:llog_process_th.0 Request processed in 258us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862329.489637:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787862329.489777:0:11749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11749:1874709246440192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862329.489811:0:11749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862329.489824:0:11749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862329.489826:0:11749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787862329.489834:0:11749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89a102aa4000 00000020:00000080:3.0:1787862329.489837:0:11749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787862329.489947:0:11749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11749:1874709246440320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862329.489992:0:11749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.490130:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440320 00000100:00100000:0.0:1787862329.490136:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440320 00000100:00100000:0.0:1787862329.490161:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787862329.490168:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:11749:x1874709246440320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862329.490338:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:11749:x1874709246440320:12345-0@lo:502:llog_process_th.0 Request processed in 170us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.490346:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787862329.491983:0:11749:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862329.492377:0:11749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11749:1874709246440320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862329.492434:0:11749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862329.492446:0:11749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862329.492462:0:11749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787862329.492467:0:11749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787862329.492554:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787862329.492581:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862329.492595:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862329.492608:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862329.492621:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787862329.492625:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a1102e9000 from 7 10000000:01000000:3.0:1787862329.492640:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862329.492683:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862329.492692:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862329.492703:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862329.492729:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862329.492813:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862329.492857:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862329.492988:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440448 00000100:00100000:3.0:1787862329.492996:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440448 00000100:00100000:1.0:1787862329.498510:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787862329.498546:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:5865:x1874709246440448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862329.498572:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862329.498603:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cd9d8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9d88 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.498676:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cd9d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9d88 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.498690:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cd9d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9d88 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.498701:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9e00, rc 0) 00000100:00100000:1.0:1787862329.498836:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246440448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (6022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.498843:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787862329.500489:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862329.500531:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862329.500540:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1787862329.500568:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862329.500642:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333504 00000100:00100000:0.0:1787862329.500652:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333504 00000100:00100000:3.0:1787862329.500706:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.500728:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 271 00000100:00100000:0.0:1787862329.500739:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223333504:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862329.500769:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862329.500816:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862329.500833:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440576 00000100:00100000:3.0:1787862329.500837:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440576 00000100:00100000:3.0:1787862329.500864:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787862329.500872:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246440576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.501203:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223333504:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 464us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.501215:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 271 00000100:00100000:3.0:1787862329.501420:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246440576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 547us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862329.501428:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787862329.504615:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.504746:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.504869:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.504931:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a120664c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862329.505089:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440704 00000100:00100000:1.0:1787862329.505097:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440704 00000100:00100000:1.0:1787862329.505162:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787862329.505174:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246440704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862329.505474:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246440704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.505483:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787862329.505495:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862329.505522:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333632 00000100:00100000:1.0:1787862329.505526:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333632 00000100:00100000:1.0:1787862329.505549:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 274 00000100:00100000:1.0:1787862329.505555:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223333632:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862329.505696:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:5598:x1874709223333632:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 139us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.505704:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 274 00000100:00100000:0.0:1787862329.505904:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246440704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.508825:0:11751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11751:1874709246440832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862329.508948:0:11751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.509002:0:11751:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a120664540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862329.509271:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440832 00000100:00100000:3.0:1787862329.509282:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440832 00000100:00100000:3.0:1787862329.509341:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787862329.509353:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:11751:x1874709246440832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862329.509688:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:11751:x1874709246440832:12345-0@lo:502:llog_process_th.0 Request processed in 335us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862329.509696:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787862329.509726:0:11751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11751:1874709246440832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862329.509762:0:11751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862329.509774:0:11751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862329.509777:0:11751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787862329.509785:0:11751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89a1102e9000 00000020:00000080:0.0:1787862329.509788:0:11751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787862329.509884:0:11751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11751:1874709246440960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862329.509925:0:11751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.509954:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246440960 00000100:00100000:0.0:1787862329.509959:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246440960 00000100:00100000:0.0:1787862329.509982:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787862329.509988:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:11751:x1874709246440960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862329.510170:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:11751:x1874709246440960:12345-0@lo:502:llog_process_th.0 Request processed in 179us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.510177:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787862329.510218:0:11751:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105589480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862329.510230:0:11751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11751:1874709246440960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862329.510260:0:11751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862329.510265:0:11751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862329.510266:0:11751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787862329.510270:0:11751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787862329.512851:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787862329.512893:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862329.512907:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.512922:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862329.512937:0:5865:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862329.512948:0:5865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a102b43800 from 7 10000000:01000000:1.0:1787862329.512950:0:5865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862329.512996:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.513002:0:5865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.513012:0:5865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862329.513078:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246441088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862329.513175:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862329.513236:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862329.513269:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441088 00000100:00100000:0.0:1787862329.513402:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441088 00000100:00100000:0.0:1787862329.513470:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787862329.513480:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:5865:x1874709246441088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862329.513495:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862329.513511:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a142161600/0x391a6cd368cd9d9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cd9d96 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.513539:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a142161600/0x391a6cd368cd9d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cd9d96 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.513552:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a142161600/0x391a6cd368cd9d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cd9d96 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.513562:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142161600, rc 0) 00000100:00100000:0.0:1787862329.513623:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246441088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.513644:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787862329.513816:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246441088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862329.513836:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862329.513846:0:5865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862329.513911:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246441216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862329.513941:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862329.513974:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862329.514025:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441216 00000100:00100000:0.0:1787862329.514030:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441216 00000100:00100000:0.0:1787862329.514992:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787862329.515010:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246441216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.515662:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246441216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 654us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.515672:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787862329.515769:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246441216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.515841:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246441344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862329.515893:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.515917:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e40540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862329.515941:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441344 00000100:00100000:0.0:1787862329.515948:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441344 00000100:00100000:0.0:1787862329.515982:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787862329.515989:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246441344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862329.520691:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862329.520746:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333760 00000100:00100000:1.0:1787862329.523259:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333760 00000100:00100000:1.0:1787862329.523363:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 280 00000100:00100000:1.0:1787862329.523378:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:10061:x1874709223333760:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862329.523766:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:10061:x1874709223333760:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 390us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.523776:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 280 00000100:00100000:0.0:1787862329.533033:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:5865:x1874709246441344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 17016us (17112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862329.533067:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787862329.533109:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:5865:1874709246441344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862329.547220:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862329.547409:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223333888 00000100:00100000:1.0:1787862329.547420:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223333888 00000100:00100000:1.0:1787862329.547482:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 281 00000100:00100000:1.0:1787862329.547493:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:10061:x1874709223333888:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862329.547868:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:10061:x1874709223333888:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 374us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.547877:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 281 00000100:00100000:0.0:1787862329.548731:0:11753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11753:1874709246441472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862329.548815:0:11753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862329.548864:0:11753:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862329.549404:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441472 00000100:00100000:1.0:1787862329.549414:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441472 00000100:00100000:1.0:1787862329.549471:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787862329.549480:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:11753:x1874709246441472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862329.549742:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:11753:x1874709246441472:12345-0@lo:502:llog_process_th.0 Request processed in 262us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.549751:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787862329.549829:0:11753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11753:1874709246441472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862329.549867:0:11753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862329.549880:0:11753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862329.549884:0:11753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787862329.549893:0:11753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89a102b43800 00000020:00000080:2.0:1787862329.549895:0:11753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787862329.550002:0:11753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11753:1874709246441600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862329.550071:0:11753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862329.550093:0:11753:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112e409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862329.552162:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441600 00000100:00100000:1.0:1787862329.552181:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441600 00000100:00100000:1.0:1787862329.552348:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787862329.552365:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:11753:x1874709246441600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862329.552737:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:11753:x1874709246441600:12345-0@lo:502:llog_process_th.0 Request processed in 376us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862329.552745:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787862329.557314:0:11753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:11753:1874709246441600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862329.557399:0:11753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862329.557415:0:11753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862329.557419:0:11753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787862329.557426:0:11753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787862329.560181:0:5865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787862329.560232:0:5865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862329.560247:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862329.560260:0:5865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862329.580893:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787862330.501875:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862330.628965:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787862330.712365:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862330.712465:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862330.712583:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334016 00000100:00100000:2.0:1787862330.712598:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334016 00000100:00100000:2.0:1787862330.712679:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 284 00000100:00100000:2.0:1787862330.712692:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223334016:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862330.712724:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334144 00000100:00100000:0.0:1787862330.712728:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334144 00000100:00100000:2.0:1787862330.712796:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1193e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223334016:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862330.712798:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:2.0:1787862330.712805:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 284 00000100:00100000:0.0:1787862330.712806:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223334144:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862330.712840:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223334144:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 37us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862330.712846:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00080000:3.0:1787862330.713222:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862330.715972:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862330.716117:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334272 00000100:00100000:2.0:1787862330.716130:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334272 00000100:00100000:2.0:1787862330.716245:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:2.0:1787862330.716257:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223334272:12345-192.168.202.9@tcp:400:kworker.0 00000100:00080000:3.0:1787862330.716699:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862330.717671:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223334272:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 974us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862330.717686:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:1.0:1787862330.717902:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862330.724123:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334400 00000100:00100000:2.0:1787862330.724146:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334400 00000100:00100000:2.0:1787862330.724401:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:2.0:1787862330.724415:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223334400:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862330.725666:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223334400:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 1244us (7753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862330.725679:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00080000:3.0:1787862330.729648:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862331.396548:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246441856:0@lo:400:kworker.0 00000100:00100000:2.0:1787862331.396665:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862331.396762:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246442368:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.396771:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246441984:0@lo:400:kworker.0 00000100:00100000:2.0:1787862331.396793:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862331.396802:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862331.396838:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862331.396838:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862331.396845:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246441728:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.396845:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246442112:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.396868:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862331.396874:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862331.396890:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246442240:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.396903:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442368 00000100:00100000:2.0:1787862331.396911:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862331.396911:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442368 00000100:00100000:2.0:1787862331.396939:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441856 00000100:00100000:2.0:1787862331.396942:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441856 00000100:00100000:2.0:1787862331.396978:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441984 00000100:00100000:2.0:1787862331.396981:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441984 00000100:00100000:1.0:1787862331.396988:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442112 00000100:00100000:1.0:1787862331.396991:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442112 00000100:00100000:2.0:1787862331.397009:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442240 00000100:00100000:2.0:1787862331.397012:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442240 00000100:00100000:1.0:1787862331.397018:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862331.397025:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787862331.397027:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246442368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862331.397031:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246441856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862331.397108:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246441856:12345-0@lo:400:kworker.0 Request processed in 75us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862331.397116:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787862331.397135:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787862331.397141:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246441984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862331.397174:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246441984:12345-0@lo:400:kworker.0 Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862331.397181:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787862331.397191:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787862331.397198:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246442240:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787862331.397461:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862331.397468:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862331.397479:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862331.397516:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787862331.397526:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.397530:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246442368:12345-0@lo:400:kworker.0 Request processed in 503us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862331.397537:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787862331.397563:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246442112:12345-0@lo:400:kworker.0 Request processed in 40us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862331.397570:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862331.397643:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246441728 00000100:00100000:0.0:1787862331.397648:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246441728 00000100:00100000:0.0:1787862331.397688:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787862331.397699:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246441728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862331.397736:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246441728:12345-0@lo:400:kworker.0 Request processed in 42us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862331.397743:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00080000:0.0:1787862331.397801:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35ed00 x1874709246442112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862331.397817:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246442112:0@lo:400:kworker.0 00000100:00100000:0.0:1787862331.397829:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246441984:0@lo:400:kworker.0 00000100:00100000:2.0:1787862331.403181:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246442240:12345-0@lo:400:kworker.0 Request processed in 5799us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862331.403202:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787862331.410059:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246442240:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.410090:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246442368:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.410105:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246441856:0@lo:400:kworker.0 00000100:00100000:1.0:1787862331.410143:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246441728:0@lo:400:kworker.0 00010000:00010000:1.0:1787862331.524305:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862331.908479:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246442496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862331.908577:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862331.908735:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442496 00000100:00100000:3.0:1787862331.908748:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442496 00000100:00100000:3.0:1787862331.908818:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787862331.908829:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246442496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862331.908878:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862331.908931:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246442496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862331.908938:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787862331.909547:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246442496:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787862331.998962:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787862332.000183:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787862332.548644:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862333.572404:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862334.470690:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862334.470725:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246442624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862334.470826:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862334.471532:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442624 00000100:00100000:0.0:1787862334.471544:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442624 00000100:00100000:0.0:1787862334.471641:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862334.471653:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246442624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862334.471708:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862334.471777:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246442624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862334.471785:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787862334.471849:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862334.471938:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35ed00 x1874709246442624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862334.471973:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246442624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862334.597349:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862335.620396:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862335.834658:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862335.834697:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862335.834740:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862335.834786:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862335.834795:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334656 00000100:00100000:3.0:1787862335.834811:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334656 00000100:00080000:0.0:1787862335.834855:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862335.834908:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334912 00000100:00100000:3.0:1787862335.834911:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334912 00000100:00100000:1.0:1787862335.834923:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:1.0:1787862335.834943:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223334656:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862335.834950:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:3.0:1787862335.834963:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223334912:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862335.835080:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334528 00000100:00100000:2.0:1787862335.835086:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334528 00000100:00100000:3.0:1787862335.835100:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223334912:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 138us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862335.835109:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:2.0:1787862335.835138:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 286 00000100:00100000:2.0:1787862335.835149:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223334528:12345-192.168.202.9@tcp:400:kworker.0 00000100:00080000:0.0:1787862335.835249:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862335.835329:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223334784 00000100:00100000:3.0:1787862335.835333:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223334784 00000100:00100000:3.0:1787862335.840262:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:3.0:1787862335.840308:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223334784:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862335.841734:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223334656:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 6783us (7078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862335.843609:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00080000:1.0:1787862335.843715:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862335.844791:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223334528:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 9635us (10040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862335.844809:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 286 00000100:00100000:3.0:1787862335.849818:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223334784:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 9501us (15012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862335.849839:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:2.0:1787862336.516492:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246443008:0@lo:400:kworker.0 00000100:00100000:2.0:1787862336.516620:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862336.516721:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862336.516728:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246443136:0@lo:400:kworker.0 00000100:00100000:2.0:1787862336.516759:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862336.517019:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246442880:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517097:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862336.517117:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246443392:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517139:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862336.517162:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862336.517167:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246442752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517198:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862336.517223:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246443264:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517246:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862336.517281:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443136 00000100:00100000:1.0:1787862336.517290:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443136 00000100:00100000:1.0:1787862336.517354:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443392 00000100:00100000:1.0:1787862336.517357:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443392 00000100:00100000:1.0:1787862336.517382:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787862336.517391:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517474:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246443136:12345-0@lo:400:kworker.0 Request processed in 83us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862336.517483:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787862336.517502:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862336.517509:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246443392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517759:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246443392:12345-0@lo:400:kworker.0 Request processed in 248us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862336.517784:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862336.517809:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442752 00000100:00100000:1.0:1787862336.517813:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442752 00000100:00100000:1.0:1787862336.517842:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787862336.517848:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246442752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.517879:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246442752:12345-0@lo:400:kworker.0 Request processed in 32us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862336.517885:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787862336.517916:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443008 00000100:00100000:1.0:1787862336.517921:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443008 00000100:00100000:1.0:1787862336.517949:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246442880 00000100:00100000:1.0:1787862336.517953:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246442880 00000100:00100000:1.0:1787862336.517963:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443264 00000100:00100000:1.0:1787862336.517965:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443264 00000100:00100000:1.0:1787862336.517981:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787862336.517987:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.518148:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246443008:12345-0@lo:400:kworker.0 Request processed in 159us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862336.518155:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787862336.518168:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787862336.518175:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246442880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.518201:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246442880:12345-0@lo:400:kworker.0 Request processed in 27us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862336.518207:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787862336.518217:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787862336.518223:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.518261:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246443264:12345-0@lo:400:kworker.0 Request processed in 39us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862336.518267:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1787862336.518285:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862336.518291:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862336.518294:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862336.518337:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246442752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.518353:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246443264:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.518361:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246442880:0@lo:400:kworker.0 00000100:00100000:1.0:1787862336.518371:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787862336.518377:0:3330:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13c0a5680, transno 4294967300 00000100:00100000:1.0:1787862336.518392:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246443392:0@lo:400:kworker.0 00010000:00080000:2.0:1787862336.518634:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d35c000 x1874709246443136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862336.518647:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246443136:0@lo:400:kworker.0 00000100:00100000:2.0:1787862336.518659:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246443008:0@lo:400:kworker.0 00010000:00010000:2.0:1787862336.644306:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862337.032374:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862337.032409:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246443520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862337.032514:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862337.033005:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443520 00000100:00100000:0.0:1787862337.033016:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443520 00000100:00100000:0.0:1787862337.033298:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862337.033310:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246443520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862337.033361:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862337.033430:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246443520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862337.033439:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787862337.039915:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246443520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862337.669375:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862338.702653:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862339.588516:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246443648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862339.588677:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862339.588776:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443648 00000100:00100000:1.0:1787862339.588787:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443648 00000100:00100000:1.0:1787862339.588868:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787862339.588880:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246443648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862339.588937:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787862339.589493:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862339.597291:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246443648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8396us (8597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862339.597314:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787862339.597633:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a112c63480 x1874709246443648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862339.597677:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246443648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862339.722990:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862340.742607:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862340.868801:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787862340.961662:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862340.961715:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862340.961853:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335296 00000100:00100000:3.0:1787862340.961864:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335296 00000100:00100000:3.0:1787862340.961940:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:3.0:1787862340.961950:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223335296:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862340.962034:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223335296:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 85us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862340.962091:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:0.0:1787862340.962989:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862340.963034:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862340.963331:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335168 00000100:00100000:0.0:1787862340.963339:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335168 00000100:00100000:0.0:1787862340.963380:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335424 00000100:00100000:0.0:1787862340.963383:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335424 00000100:00100000:0.0:1787862340.963406:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 139 00000100:00100000:0.0:1787862340.963414:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223335168:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862340.963473:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223335168:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 59us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862340.963480:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 139 00000100:00100000:0.0:1787862340.963509:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 140 00000100:00100000:0.0:1787862340.963515:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223335424:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862340.963557:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223335424:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862340.963564:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 140 00000100:00100000:2.0:1787862340.964614:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335040 00000100:00100000:2.0:1787862340.964624:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335040 00000100:00100000:2.0:1787862340.964684:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 288 00000100:00100000:2.0:1787862340.964693:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223335040:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862340.964736:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223335040:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 45us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862340.964743:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 288 00000100:00080000:2.0:1787862340.964782:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862340.964788:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862341.638387:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246443904:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.638497:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862341.638566:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246444416:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.638594:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862341.638641:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862341.638647:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246443776:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.638677:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862341.638699:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246444288:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.638723:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862341.638767:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444416 00000100:00100000:1.0:1787862341.638773:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444416 00000100:00100000:1.0:1787862341.638827:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862341.638835:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443904 00000100:00100000:1.0:1787862341.638836:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246444416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862341.638839:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443904 00000100:00100000:0.0:1787862341.638862:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444288 00000100:00100000:0.0:1787862341.638864:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444288 00000100:00100000:0.0:1787862341.638882:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787862341.638886:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246444416:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862341.638888:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246443904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.638894:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862341.638921:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246443904:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862341.638927:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787862341.638930:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246443776 00000100:00100000:0.0:1787862341.638938:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787862341.638941:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246443776 00000100:00100000:0.0:1787862341.638944:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.638963:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787862341.638969:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246443776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862341.638970:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246444288:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862341.638975:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787862341.638996:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246443776:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862341.639002:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787862341.639069:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246443776:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.639085:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246444288:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.639093:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246443904:0@lo:400:kworker.0 00000100:00100000:1.0:1787862341.639102:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246444416:0@lo:400:kworker.0 00000100:00100000:2.0:1787862341.640133:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246444032:0@lo:400:kworker.0 00000100:00100000:2.0:1787862341.640209:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862341.640322:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862341.640330:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b978f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246444160:0@lo:400:kworker.0 00000100:00100000:2.0:1787862341.640361:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787862341.640405:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862341.640412:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862341.640966:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444160 00000100:00100000:3.0:1787862341.640975:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444160 00000100:00100000:3.0:1787862341.641069:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787862341.641081:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246444160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862341.641143:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246444160:12345-0@lo:400:kworker.0 Request processed in 65us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862341.641185:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787862341.641216:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444032 00000100:00100000:3.0:1787862341.641220:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444032 00000100:00100000:3.0:1787862341.641261:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787862341.641268:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246444032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862341.641301:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246444032:12345-0@lo:400:kworker.0 Request processed in 34us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862341.641307:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1787862341.641751:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862341.641756:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862341.641789:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13b978f00 x1874709246444160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862341.641804:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b978f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246444160:0@lo:400:kworker.0 00000100:00100000:2.0:1787862341.641816:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246444032:0@lo:400:kworker.0 00010000:00010000:3.0:1787862341.772526:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862342.149505:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246444544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862342.149591:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862342.149810:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444544 00000100:00100000:2.0:1787862342.149818:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444544 00000100:00100000:2.0:1787862342.157273:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862342.157311:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246444544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862342.157356:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862342.158186:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246444544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (7860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862342.158198:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787862342.158392:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246444544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862342.788328:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862343.819215:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862344.708966:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246444672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862344.709074:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862344.709811:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444672 00000100:00100000:2.0:1787862344.709822:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444672 00000100:00100000:2.0:1787862344.709893:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787862344.709904:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246444672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862344.709938:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862344.710071:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246444672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862344.710078:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787862344.710296:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787862344.712742:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13b97b480 x1874709246444672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862344.712779:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246444672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862344.836435:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862345.869393:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862346.071360:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862346.071417:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862346.071547:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335680 00000100:00100000:2.0:1787862346.071557:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335680 00000100:00100000:2.0:1787862346.071662:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 144 00000100:00100000:2.0:1787862346.071673:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223335680:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862346.071755:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223335680:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862346.071773:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 144 00000100:00100000:0.0:1787862346.071966:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335552 00000100:00100000:0.0:1787862346.071971:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335552 00000100:00100000:0.0:1787862346.072017:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 290 00000100:00100000:0.0:1787862346.072271:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223335552:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862346.072320:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223335552:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 126us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862346.072327:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 290 00000100:00080000:0.0:1787862346.072918:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862346.087426:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862346.087545:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862346.088185:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335808 00000100:00100000:3.0:1787862346.088206:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335808 00000100:00100000:3.0:1787862346.088291:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:3.0:1787862346.088302:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2351:x1874709223335808:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1787862346.088335:0:9223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9cd9 00000100:00080000:3.0:1787862346.088345:0:9223:0:(import.c:65:import_set_state_nolock()) ffff89a006607800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787862346.088384:0:9223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787862346.088705:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+2:2351:x1874709223335808:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 403us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862346.088715:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00080000:1.0:1787862346.088963:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862346.089144:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223335936 00000100:00100000:0.0:1787862346.089151:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223335936 00000100:00100000:0.0:1787862346.089212:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 145 00000100:00100000:0.0:1787862346.089221:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223335936:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862346.089265:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223335936:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 46us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862346.089273:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 145 00010000:00010000:0.0:1787862346.089292:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862346.089389:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862346.756424:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246444928:0@lo:400:kworker.0 00000100:00100000:2.0:1787862346.756496:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246445056:0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.756543:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862346.756624:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246444800:0@lo:400:kworker.0 00000100:00100000:1.0:1787862346.759948:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b9783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246445184:0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.768804:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246445440:0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.768903:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862346.768998:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444928 00000100:00100000:0.0:1787862346.769008:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444928 00000100:00100000:0.0:1787862346.769098:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787862346.769110:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.769190:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246444928:12345-0@lo:400:kworker.0 Request processed in 82us (12649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862346.769198:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787862346.769261:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246444928:0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.769321:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445440 00000100:00100000:0.0:1787862346.769344:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445440 00000100:00100000:0.0:1787862346.769400:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787862346.769407:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b9792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246445440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.769451:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b9792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246445440:12345-0@lo:400:kworker.0 Request processed in 44us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862346.769458:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787862346.769502:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246445440:0@lo:400:kworker.0 00000100:00080000:0.0:1787862346.769528:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862346.771876:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862346.772801:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445056 00000100:00100000:0.0:1787862346.772815:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445056 00000100:00100000:0.0:1787862346.772897:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787862346.772908:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246445056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.772996:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246445056:12345-0@lo:400:kworker.0 Request processed in 90us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862346.773005:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787862346.776590:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862346.776766:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246445312:0@lo:400:kworker.0 00000100:00100000:3.0:1787862346.776829:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862346.776932:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445312 00000100:00100000:3.0:1787862346.776943:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445312 00000100:00080000:2.0:1787862346.776972:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862346.777026:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787862346.777075:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246445312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862346.777097:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246445056:0@lo:400:kworker.0 00000100:00100000:3.0:1787862346.777181:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246445312:12345-0@lo:400:kworker.0 Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862346.777192:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787862346.777224:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246445312:0@lo:400:kworker.0 00000100:00100000:1.0:1787862346.783663:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862346.785940:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445184 00000100:00100000:3.0:1787862346.785964:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445184 00000100:00100000:3.0:1787862346.786166:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787862346.786181:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246445184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862346.786327:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246445184:12345-0@lo:400:kworker.0 Request processed in 150us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862346.786336:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787862346.786694:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787862346.786728:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13b9783c0 x1874709246445184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862346.786748:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b9783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246445184:0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.786811:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246444800 00000100:00100000:0.0:1787862346.786822:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246444800 00000100:00100000:0.0:1787862346.786877:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787862346.786886:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246444800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862346.786954:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246444800:12345-0@lo:400:kworker.0 Request processed in 68us (10376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862346.786963:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787862346.787092:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246444800:0@lo:400:kworker.0 00010000:00010000:3.0:1787862346.884575:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862347.271543:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862347.271585:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246445568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862347.271691:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862347.271797:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445568 00000100:00100000:3.0:1787862347.271810:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445568 00000100:00100000:2.0:1787862347.272122:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787862347.272139:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246445568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862347.272200:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862347.272312:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246445568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862347.272323:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862347.283627:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246445568:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787862347.338079:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:0.0:1787862347.338090:0:7661:0:(genops.c:885:class_export_put()) final put ffff89a006606800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:1.0:1787862347.338696:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a006606800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 for lustre-OST0001 00000020:00000080:1.0:1787862347.338762:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a006607800 for lustre-OST0001 00010000:00010000:2.0:1787862347.909770:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862348.933132:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862349.828368:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246445696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862349.828490:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862349.828635:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445696 00000100:00100000:0.0:1787862349.828645:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445696 00000100:00100000:0.0:1787862349.828753:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787862349.828765:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246445696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862349.828814:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787862349.829272:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862349.829415:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246445696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 650us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862349.829425:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787862349.829499:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13b979e00 x1874709246445696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862349.829532:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246445696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862349.960104:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862350.086736:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787862350.993310:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862351.191540:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862351.191589:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862351.191623:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862351.191658:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336192 00000100:00100000:3.0:1787862351.191670:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336192 00000100:00100000:3.0:1787862351.191749:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336320 00000100:00100000:3.0:1787862351.191753:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336320 00000100:00100000:3.0:1787862351.191780:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 149 00000100:00100000:3.0:1787862351.191792:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223336192:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862351.191925:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223336192:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 134us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862351.191935:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 149 00000100:00100000:3.0:1787862351.191955:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:3.0:1787862351.191961:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223336320:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862351.191988:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223336320:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862351.191994:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00080000:3.0:1787862351.192009:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862351.194596:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336064 00000100:00100000:2.0:1787862351.194617:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336064 00000100:00100000:2.0:1787862351.194878:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 292 00000100:00100000:2.0:1787862351.194890:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223336064:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862351.197805:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223336064:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 2897us (6196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862351.197825:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 292 00000100:00100000:1.0:1787862351.880818:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246446208:0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.880985:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246445824:0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.881122:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862351.881204:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246446336:0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.881238:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862351.881272:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787862351.881279:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246445952:0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.881564:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862351.881589:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246446464:0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.881623:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862351.881662:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246446080:0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.881694:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862351.881736:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445824 00000100:00100000:2.0:1787862351.881747:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445824 00000100:00100000:2.0:1787862351.881815:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787862351.881827:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862351.881997:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862351.882059:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446464 00000100:00100000:1.0:1787862351.882064:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446464 00000100:00100000:1.0:1787862351.882118:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446208 00000100:00100000:1.0:1787862351.882133:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446208 00000100:00100000:1.0:1787862351.882164:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787862351.882172:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246446464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862351.882246:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246446464:12345-0@lo:400:kworker.0 Request processed in 74us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862351.882255:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787862351.882278:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862351.883000:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246445824:12345-0@lo:400:kworker.0 Request processed in 1169us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862351.883011:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787862351.883080:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446336 00000100:00100000:2.0:1787862351.883087:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446336 00000100:00100000:2.0:1787862351.883130:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246445952 00000100:00100000:2.0:1787862351.883134:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246445952 00000100:00100000:2.0:1787862351.883148:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446080 00000100:00100000:2.0:1787862351.883150:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446080 00000100:00100000:2.0:1787862351.883166:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787862351.883173:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246446336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.883213:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246446336:12345-0@lo:400:kworker.0 Request processed in 40us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862351.883220:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787862351.883232:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787862351.883238:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246445952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862351.883267:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246445952:12345-0@lo:400:kworker.0 Request processed in 29us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862351.883408:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862351.883724:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787862351.883738:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246446080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862351.883787:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246446080:12345-0@lo:400:kworker.0 Request processed in 55us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862351.883794:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787862351.883894:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1205821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246445952:0@lo:400:kworker.0 00000100:00100000:3.0:1787862351.883912:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246446464:0@lo:400:kworker.0 00000100:00100000:3.0:1787862351.883924:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246445824:0@lo:400:kworker.0 00000100:00100000:3.0:1787862351.883938:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246446336:0@lo:400:kworker.0 00000100:00100000:3.0:1787862351.883993:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246446080:0@lo:400:kworker.0 00000100:00080000:3.0:1787862351.884071:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862351.884078:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862351.884080:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862351.884565:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246446208:12345-0@lo:400:kworker.0 Request processed in 2278us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862351.884576:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862351.885767:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00080000:3.0:1787862351.885956:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c6a6940 x1874709246446208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862351.885996:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246446208:0@lo:400:kworker.0 00010000:00010000:0.0:1787862352.004532:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862352.389828:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862352.389863:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246446592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862352.389973:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862352.390078:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446592 00000100:00100000:0.0:1787862352.390088:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446592 00000100:00100000:0.0:1787862352.390156:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862352.390166:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246446592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862352.390217:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862352.390274:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246446592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862352.390282:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862352.390636:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246446592:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787862352.919711:0:11918:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:25:51 (1787862351) 00010000:00010000:0.0:1787862353.028388:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862354.052906:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862354.816084:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862354.816429:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336448 00000100:00100000:1.0:1787862354.816446:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336448 00000100:00100000:1.0:1787862354.816557:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:1.0:1787862354.816572:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:10330:x1874709223336448:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862354.816605:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862354.816642:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9da4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05a9 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862354.816745:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9dab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862354.816779:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862354.816795:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862354.817380:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787862354.817408:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862354.817546:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862354.817591:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9da4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05a9 expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862354.817617:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9dab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05a9 expref: 6 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862354.817628:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862354.817632:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862354.817637:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8000, rc 0) 00000100:00100000:1.0:1787862354.817733:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:10330:x1874709223336448:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1165us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862354.817743:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00080000:3.0:1787862354.818511:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862354.832878:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862354.833097:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336576 00000100:00100000:0.0:1787862354.833110:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336576 00000100:00100000:0.0:1787862354.833201:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:0.0:1787862354.833214:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:10331:x1874709223336576:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862354.833245:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862354.833276:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cd9db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05b0 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.833365:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.833386:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.833413:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.833435:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.833443:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.833449:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834026:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160a00/0x391a6cd368cd9dc7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834067:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160a00/0x391a6cd368cd9dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834091:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160a00/0x391a6cd368cd9dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862354.834195:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787862354.834200:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862354.834286:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160a00/0x391a6cd368cd9dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834304:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834312:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834320:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834327:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862354.834333:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834342:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834358:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862354.834361:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862354.834368:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834375:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cd9db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834416:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834423:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834430:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834436:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862354.834440:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834448:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834456:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89a116882f00) 00010000:00010000:0.0:1787862354.834459:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862354.834462:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834467:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cd9dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834511:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cd9db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05b0 expref: 8 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834529:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160a00/0x391a6cd368cd9dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05b0 expref: 7 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862354.834549:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89a116882c00) 00010000:00010000:0.0:1787862354.834552:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862354.834555:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160a00, rc 0) 00000100:00100000:0.0:1787862354.834674:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10331:x1874709223336576:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1460us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862354.834684:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:1.0:1787862354.840237:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862354.841073:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336832 00000100:00100000:3.0:1787862354.841089:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336832 00000100:00100000:3.0:1787862354.841176:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:3.0:1787862354.841189:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10331:x1874709223336832:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862354.841220:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862354.841255:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9dce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05b7 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.841352:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.841371:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.841387:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.843754:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.843783:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.843817:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.845697:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cd9de3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.845722:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cd9de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.845733:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cd9de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862354.845747:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787862354.847715:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847734:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847742:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847748:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862354.847754:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847762:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847778:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89a116882c00) 00010000:00010000:3.0:1787862354.847781:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862354.847801:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847808:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847824:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847830:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847835:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847840:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862354.847843:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.847849:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.850529:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89a108824c00) 00010000:00010000:3.0:1787862354.850533:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862354.850544:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.850552:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9ddc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.851160:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9dce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05b7 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.851190:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cd9de3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05b7 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862354.851198:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:3.0:1787862354.851201:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862354.851204:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c000, rc 0) 00000100:00100000:3.0:1787862354.851279:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10331:x1874709223336832:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 10092us (11061us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787862354.851288:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1787862354.855593:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862354.855756:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223336960 00000100:00100000:0.0:1787862354.855777:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223336960 00000100:00100000:0.0:1787862354.855871:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:0.0:1787862354.855885:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10331:x1874709223336960:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787862354.856489:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10331:x1874709223336960:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 596us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862354.856501:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:2.0:1787862354.956202:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862354.956236:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246446720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862354.956339:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862354.958793:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446720 00000100:00100000:3.0:1787862354.958812:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446720 00000100:00100000:3.0:1787862354.958942:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787862354.958954:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246446720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862354.959011:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862354.959257:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246446720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862354.959265:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787862354.959358:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862354.959891:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13c6a4000 x1874709246446720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862354.959927:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246446720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862355.077480:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862355.204931:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787862356.107413:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862356.309282:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862356.309350:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862356.309409:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862356.309529:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337216 00000100:00100000:2.0:1787862356.309543:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337216 00000100:00100000:2.0:1787862356.309631:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337344 00000100:00100000:2.0:1787862356.309635:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337344 00000100:00100000:2.0:1787862356.309675:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 154 00000100:00100000:2.0:1787862356.309686:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2355:x1874709223337216:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862356.309789:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2355:x1874709223337216:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 103us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862356.309798:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 154 00000100:00100000:2.0:1787862356.309819:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 155 00000100:00100000:2.0:1787862356.309826:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223337344:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862356.309854:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223337344:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862356.309860:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 155 00000100:00080000:0.0:1787862356.310239:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862356.310689:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337088 00000100:00100000:1.0:1787862356.310698:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337088 00000100:00100000:1.0:1787862356.310753:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 294 00000100:00100000:1.0:1787862356.310761:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223337088:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862356.310824:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223337088:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 63us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862356.310832:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 294 00000100:00100000:0.0:1787862357.008008:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246447232:0@lo:400:kworker.0 00000100:00100000:0.0:1787862357.008130:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.008359:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246446848:0@lo:400:kworker.0 00000100:00100000:3.0:1787862357.008412:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.008551:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446848 00000100:00100000:3.0:1787862357.008560:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446848 00000100:00100000:3.0:1787862357.008623:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787862357.008635:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246446848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862357.008699:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246446848:12345-0@lo:400:kworker.0 Request processed in 66us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.008725:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787862357.008933:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862357.008942:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246447104:0@lo:400:kworker.0 00000100:00100000:0.0:1787862357.008977:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862357.009010:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246447232 00000100:00100000:0.0:1787862357.009014:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246447232 00000100:00100000:0.0:1787862357.009099:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787862357.009107:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246447232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862357.009153:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246447232:12345-0@lo:400:kworker.0 Request processed in 47us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862357.009160:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787862357.009181:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246447104 00000100:00100000:0.0:1787862357.009185:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246447104 00000100:00100000:0.0:1787862357.009577:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787862357.009585:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246447104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862357.009626:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246447104:12345-0@lo:400:kworker.0 Request processed in 42us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862357.009633:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1787862357.009654:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862357.009659:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862357.010092:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246446976:0@lo:400:kworker.0 00000100:00100000:1.0:1787862357.010142:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.010666:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246446848:0@lo:400:kworker.0 00000100:00100000:3.0:1787862357.010679:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b9783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246447360:0@lo:400:kworker.0 00000100:00100000:3.0:1787862357.010720:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.010775:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246446976 00000100:00100000:3.0:1787862357.010782:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246446976 00000100:00100000:3.0:1787862357.010820:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246447360 00000100:00100000:3.0:1787862357.010823:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246447360 00000100:00100000:3.0:1787862357.010851:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787862357.010859:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246446976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862357.010912:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874709246446976:12345-0@lo:400:kworker.0 Request processed in 53us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.010920:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787862357.010937:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787862357.010944:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246447360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862357.010977:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246447360:12345-0@lo:400:kworker.0 Request processed in 33us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.010983:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787862357.011014:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b9783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246447360:0@lo:400:kworker.0 00000100:00100000:1.0:1787862357.012588:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874709246446976:0@lo:400:kworker.0 00000100:00100000:1.0:1787862357.012605:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b979680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246447488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862357.012679:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787862357.012957:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862357.013163:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246447104:0@lo:400:kworker.0 00010000:00080000:0.0:1787862357.013186:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13b97b0c0 x1874709246447232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862357.014319:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246447232:0@lo:400:kworker.0 00000100:00100000:2.0:1787862357.015634:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246447488 00000100:00100000:2.0:1787862357.015660:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246447488 00000100:00100000:2.0:1787862357.015755:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862357.015768:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246447488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862357.015901:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246447488:12345-0@lo:400:kworker.0 Request processed in 135us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.015909:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862357.015972:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b979680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246447488:0@lo:400:kworker.0 00000100:00080000:0.0:1787862357.016182:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787862357.124684:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862357.151918:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.152233:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337472 00000100:00100000:3.0:1787862357.152247:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337472 00000100:00100000:3.0:1787862357.152329:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:3.0:1787862357.152342:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10374:x1874709223337472:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862357.152379:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862357.152425:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9df1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05be expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152525:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152544:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152560:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152599:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152609:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152616:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152961:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152971:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152979:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.152986:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862357.152992:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153011:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153027:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862357.153031:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862357.153070:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153078:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153096:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153103:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153110:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153116:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862357.153119:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153126:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153134:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89a108824c00) 00010000:00010000:3.0:1787862357.153137:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862357.153140:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153157:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9dff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153203:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9df1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05be expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153216:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862357.153218:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862357.153222:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cd9df1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05be expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.153233:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2da00, rc 0) 00000100:00100000:3.0:1787862357.153329:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10374:x1874709223337472:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 989us (1427us total) trans 0 rc 301/301 00000100:00100000:3.0:1787862357.153338:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:3.0:1787862357.159718:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.162176:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337728 00000100:00100000:1.0:1787862357.162204:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337728 00000100:00100000:1.0:1787862357.162290:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:1.0:1787862357.162305:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10374:x1874709223337728:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:1.0:1787862357.162397:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862357.162439:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9dab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05a9 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.162465:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862357.162479:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862357.162886:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.162905:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.162917:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.162932:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.162940:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.162948:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862357.164221:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787862357.164242:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.164253:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.164262:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.164269:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862357.164275:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.164285:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.164305:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:1.0:1787862357.164308:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862357.164313:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.164320:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862357.164341:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b1058d49 reply state 000000007fd459f4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862357.164352:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862357.164540:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:10374:x1874709223337728:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 2233us (4837us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787862357.164562:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00010000:00010000:0.0:1787862357.176929:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.176955:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.176964:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.176988:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862357.176995:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.177005:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.177068:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89a104fc5700) 00010000:00010000:0.0:1787862357.177072:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862357.177078:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.177086:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e0d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862357.281760:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.281930:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337856 00000100:00100000:1.0:1787862357.281945:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337856 00000100:00100000:1.0:1787862357.282029:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1787862357.282063:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:10382:x1874709223337856:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:1.0:1787862357.282099:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862357.282133:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05c5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.282239:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9e1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.282259:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.282275:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862357.282361:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787862357.282367:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862357.282438:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.282473:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05c5 expref: 11 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.282495:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05c5 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.282528:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:1.0:1787862357.282532:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862357.282537:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8000, rc 0) 00000100:00100000:1.0:1787862357.282623:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:10382:x1874709223337856:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 582us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862357.282631:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:3.0:1787862357.356229:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.356448:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223337984 00000100:00100000:1.0:1787862357.356462:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223337984 00000100:00100000:1.0:1787862357.356533:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1787862357.356545:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:10388:x1874709223337984:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862357.356574:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862357.356603:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05cc expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356690:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356708:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356722:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356740:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356747:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356777:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356925:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9600/0x391a6cd368cd9e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356934:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9600/0x391a6cd368cd9e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.356942:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9600/0x391a6cd368cd9e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862357.356980:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787862357.356984:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862357.357037:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9600/0x391a6cd368cd9e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357089:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357096:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357103:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357109:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862357.357113:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357123:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357146:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:1.0:1787862357.357149:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862357.357155:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357162:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357179:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357185:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357204:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357210:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862357.357213:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357220:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357228:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89a104fc5b00) 00010000:00010000:1.0:1787862357.357231:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862357.357234:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357240:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9e30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357291:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9e22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05cc expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357306:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9600/0x391a6cd368cd9e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05cc expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.357314:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862357.357316:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787862357.357319:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9600, rc 0) 00000100:00100000:1.0:1787862357.357417:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:10388:x1874709223337984:12345-192.168.202.9@tcp:101:bash.0 Request processed in 874us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862357.357426:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1787862357.361774:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.361841:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223338240 00000100:00100000:1.0:1787862357.361855:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223338240 00000100:00100000:1.0:1787862357.361980:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:1.0:1787862357.361993:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:10388:x1874709223338240:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862357.362025:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862357.362108:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9e3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05d3 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.362312:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.362331:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.362345:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.362564:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.362591:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.362606:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862357.364432:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787862357.364627:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364644:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364656:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364690:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364698:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364703:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364786:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862357.364791:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364811:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364824:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862357.364826:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862357.364832:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364838:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9e45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862357.364851:0:5868:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007affa8c8 reply state 0000000033eae24e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862357.364859:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787862357.364898:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9e3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 14 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364914:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.364921:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:1.0:1787862357.364924:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862357.364926:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8200, rc 0) 00000100:00100000:1.0:1787862357.365383:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10388:x1874709223338240:12345-192.168.202.9@tcp:101:bash.0 Request processed in 3390us (3618us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787862357.365392:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00010000:00010000:0.0:1787862357.367344:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.367358:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.367365:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.367385:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862357.367390:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.367398:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.367428:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a104fc5f00) 00010000:00010000:0.0:1787862357.367431:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862357.367436:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.367442:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9e4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862357.373315:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862357.373492:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223338368 00000100:00100000:0.0:1787862357.373506:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223338368 00000100:00100000:0.0:1787862357.373557:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1787862357.373566:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874709223338368:12345-192.168.202.9@tcp:8:bash.0 00010000:00080000:0.0:1787862357.373602:0:6709:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:0.0:1787862357.373641:0:6709:0:(genops.c:1385:class_connect()) connect: client c20d7abe-3b31-4da4-909a-c5bb95bfc247, cookie 0x391a6cd368cd9e61 00002000:00100000:0.0:1787862357.373653:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c20d7abe-3b31-4da4-909a-c5bb95bfc247/ffff89a13d80f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787862357.373677:0:6709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787862357.373923:0:6709:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787862357.373953:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a13d80c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862357.374068:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2351:x1874709223338368:12345-192.168.202.9@tcp:8:bash.0 Request processed in 501us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862357.374080:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:3.0:1787862357.379168:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862357.388437:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223338496 00000100:00100000:2.0:1787862357.388451:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223338496 00000100:00100000:3.0:1787862357.389161:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1787862357.389172:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:0:x1874709223338496:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1787862357.389193:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862357.389220:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05da expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862357.389249:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862357.389267:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1787862357.389286:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862357.389297:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.389319:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.389334:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2da00, rc 0) 00000100:00100000:3.0:1787862357.389570:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:0:x1874709223338496:12345-192.168.202.9@tcp:101:bash.0 Request processed in 398us (10418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.389578:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00080000:0.0:1787862357.389679:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862357.406560:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862357.406668:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223338624 00000100:00100000:0.0:1787862357.406680:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223338624 00000100:00100000:0.0:1787862357.406766:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:0.0:1787862357.406777:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108673c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10388:x1874709223338624:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862357.406816:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862357.406837:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05e1 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.406873:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 8 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.406884:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862357.406889:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862357.406895:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.406935:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 8 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.406950:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 8 pid: 6712 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862357.406965:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1874709246447616:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862357.407117:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a007134180 going to sleep for 11 seconds 00000100:00100000:2.0:1787862357.411918:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.411998:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223338752 00000100:00100000:3.0:1787862357.412007:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223338752 00010000:00010000:3.0:1787862357.412092:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 9 pid: 6712 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862357.412128:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:3.0:1787862357.412138:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108671e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223338752:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862357.412154:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862357.412177:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 9 pid: 6712 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.412191:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 9 pid: 6712 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.412215:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862357.412233:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862357.412243:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.412254:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.412290:0:8522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862357.412305:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874709246447744:192.168.202.9@tcp:105: 00000100:00100000:3.0:1787862357.412393:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11170e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862357.415004:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8522:1874709246447744:192.168.202.9@tcp:105: 00010000:00010000:3.0:1787862357.415081:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862357.415142:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108671e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223338752:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3004us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.415153:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00010000:00010000:0.0:1787862357.416526:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f844c8c/0x391a6cd368cd9e68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05da expref: 8 pid: 6712 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862357.416548:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1874709246447616:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862357.416578:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.416609:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031600, rc 0) 00000100:00100000:0.0:1787862357.416675:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108673c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10388:x1874709223338624:12345-192.168.202.9@tcp:101:bash.0 Request processed in 9900us (10127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862357.416683:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1787862357.419718:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.419898:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223339008 00000100:00100000:3.0:1787862357.419908:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223339008 00000100:00100000:3.0:1787862357.419969:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:3.0:1787862357.419980:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10388:x1874709223339008:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:3.0:1787862357.420391:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10388:x1874709223339008:12345-192.168.202.9@tcp:35:bash.0 Request processed in 411us (693us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787862357.420399:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862357.508442:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862357.508481:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246447872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862357.508560:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.508977:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246447872 00000100:00100000:3.0:1787862357.508986:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246447872 00000100:00100000:3.0:1787862357.509078:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787862357.509088:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246447872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862357.509121:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862357.509168:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246447872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.509175:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862357.513879:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b97b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246447872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862357.528202:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862357.528888:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223339264 00000100:00100000:0.0:1787862357.528900:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223339264 00000100:00100000:0.0:1787862357.529141:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:0.0:1787862357.529150:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10398:x1874709223339264:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862357.529181:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862357.529205:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9e76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05e8 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862357.530850:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787862357.533828:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9e76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e8 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.533857:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:0.0:1787862357.533860:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862357.533867:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e8 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.533886:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031a00, rc 0) 00000100:00100000:0.0:1787862357.533993:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10398:x1874709223339264:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 4842us (5803us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787862357.534071:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:2.0:1787862357.558086:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862357.558179:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223339520 00000100:00100000:0.0:1787862357.558198:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223339520 00000100:00100000:0.0:1787862357.558293:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1787862357.558306:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10398:x1874709223339520:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1787862357.558983:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:10398:x1874709223339520:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 673us (901us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787862357.558993:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000001:00080000:1.0:1787862357.591940:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000001:00080000:1.0:1787862357.592482:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:0.0:1787862357.652570:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862357.652691:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223339648 00000100:00100000:2.0:1787862357.652705:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223339648 00000100:00100000:2.0:1787862357.652780:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:2.0:1787862357.652792:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:10404:x1874709223339648:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862357.652825:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862357.652851:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cd9e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05ef expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.652944:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cd9e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.652963:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cd9e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.652995:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cd9e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862357.653320:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787862357.653326:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862357.653425:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cd9e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.653461:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cd9e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05ef expref: 14 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.653481:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cd9e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05ef expref: 13 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.653491:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862357.653495:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862357.653499:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f000, rc 0) 00000100:00100000:2.0:1787862357.653788:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10404:x1874709223339648:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 996us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.653797:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:2.0:1787862357.670550:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862357.670752:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223339904 00000100:00100000:0.0:1787862357.670765:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223339904 00000100:00100000:0.0:1787862357.670908:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:0.0:1787862357.670922:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10404:x1874709223339904:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862357.670951:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862357.670979:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05f6 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.671423:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.671442:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.671458:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862357.671472:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787862357.671689:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05f6 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.671716:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05f6 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862357.671726:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:0.0:1787862357.671730:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862357.671734:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030e00, rc 0) 00000100:00100000:0.0:1787862357.671816:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10404:x1874709223339904:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 898us (1285us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787862357.671825:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:0.0:1787862357.675871:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862357.675928:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.676067:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223340160 00000100:00100000:1.0:1787862357.676080:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223340160 00000100:00100000:1.0:1787862357.676161:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1787862357.676174:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10404:x1874709223340160:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862357.676213:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862357.676244:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c05fd expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.676391:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9eae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.676410:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9eae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.676424:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9eae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862357.676440:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787862357.676616:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05fd expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.676637:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9eae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05fd expref: 17 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.676647:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:1.0:1787862357.676667:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862357.676673:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862357.676755:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:10404:x1874709223340160:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 583us (897us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787862357.676762:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:2.0:1787862357.677509:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223340288 00000100:00100000:2.0:1787862357.677520:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223340288 00000100:00100000:2.0:1787862357.677588:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1787862357.677598:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:2352:x1874709223340288:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862357.677613:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862357.677638:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05f6 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.677667:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:2.0:1787862357.677672:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862357.677712:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:2352:x1874709223340288:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 115us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.677720:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:0.0:1787862357.683524:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862357.683634:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223340416 00000100:00100000:2.0:1787862357.683648:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223340416 00000100:00100000:2.0:1787862357.683737:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1787862357.683749:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223340416:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:2.0:1787862357.683835:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.683866:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.683877:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862357.683883:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862357.683889:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.683968:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.683985:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862357.684147:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ade00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1874709246448000:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862357.684269:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787862357.686295:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ade00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1874709246448000:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862357.686338:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862357.687382:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862357.687914:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223340544 00000100:00100000:2.0:1787862357.687929:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223340544 00002000:00100000:2.0:1787862357.687996:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff89a13b97ad00 x1874709223340544/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:473/0 lens 504/0 e 0 to 0 dl 1787862368 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862357.688009:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13b97ad00 with x1874709223340544 ext(0->12) 00010000:00010000:2.0:1787862357.688037:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.688081:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862357.688089:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a13b97ad00 00000100:00100000:2.0:1787862357.688128:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1787862357.688141:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223340544:12345-192.168.202.9@tcp:4:lfs.0 00000001:00100000:0.0:1787862357.742236:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000001:00080000:0.0:1787862357.809685:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1787862357.810024:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223340544:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 121865us (122638us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787862357.810064:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00002000:00100000:2.0:1787862357.810100:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff89a13b97ad00 x1874709223340544/t4294967299(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:473/0 lens 504/448 e 0 to 0 dl 1787862368 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862357.810112:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13b97ad00 with x1874709223340544 ext(0->12) 00010000:00010000:2.0:1787862357.810128:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.810152:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862357.810163:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a13b97ad00 00000100:00100000:3.0:1787862357.813514:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.813929:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223340672 00000100:00100000:1.0:1787862357.813942:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223340672 00010000:00010000:1.0:1787862357.814001:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862357.814499:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:1.0:1787862357.814515:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223340672:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862357.814540:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787862357.814567:0:5853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787862357.814571:0:5853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787862357 00002000:00010000:1.0:1787862357.814573:0:5853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787862358 00002000:00010000:1.0:1787862357.814575:0:5853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787862357 00002000:00010000:1.0:1787862357.814577:0:5853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787862357.814586:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.814606:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.814647:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cd9e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05e1 expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.814700:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862357.814706:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862357.814714:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.814726:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.814779:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862357.814905:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223340672:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 394us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862357.814915:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00010000:00010000:2.0:1787862357.814995:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815006:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815068:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815077:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815086:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815094:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862357.815107:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815118:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815134:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.815142:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d34330a/0x391a6cd368cd9ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862357.815200:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223340416:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 131454us (131694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.815223:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:0.0:1787862357.820668:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.820847:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223340928 00000100:00100000:3.0:1787862357.820861:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223340928 00000100:00100000:3.0:1787862357.820974:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862357.820986:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:10404:x1874709223340928:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:3.0:1787862357.821374:0:5871:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9eae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05fd expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862357.822677:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787862357.822848:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787862357.824748:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787862357.824954:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.824980:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.824991:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.825410:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.825446:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 20 pid: 5868 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862357.825468:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5871:1874709246448128:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862357.825660:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787862357.833689:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862357.833790:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223341056 00000100:00100000:2.0:1787862357.833800:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223341056 00010000:00010000:2.0:1787862357.833852:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 21 pid: 5868 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862357.833910:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:2.0:1787862357.833923:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:2353:x1874709223341056:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862357.833943:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862357.833952:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 21 pid: 5868 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.833969:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 21 pid: 5868 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.834027:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:2.0:1787862357.834034:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.834077:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.834084:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.834105:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862357.834158:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:2353:x1874709223341056:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 239us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.834164:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00010000:00010000:3.0:1787862357.834708:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05d3 expref: 20 pid: 5868 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862357.834725:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5871:1874709246448128:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862357.834753:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.834761:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.834765:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862357.834933:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787862357.835279:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787862357.835438:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246448256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787862357.835518:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.835694:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862357.839530:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246448256 00000100:00100000:2.0:1787862357.839552:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246448256 00000100:00100000:2.0:1787862357.839681:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862357.839693:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5871:x1874709246448256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787862357.839924:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5871:x1874709246448256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 233us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.839933:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862357.840196:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246448256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787862357.841453:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787862357.841582:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c61680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246448384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787862357.841676:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862357.841784:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787862357.841907:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246448384 00000100:00100000:0.0:1787862357.841916:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246448384 00000100:00100000:0.0:1787862357.842031:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862357.842086:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1874709246448384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862357.842422:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5871:x1874709246448384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 380us (744us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787862357.842431:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862357.842625:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c61680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246448384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787862357.842731:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787862357.842794:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.842806:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.842814:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.842820:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862357.842825:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.842844:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.842866:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:1.0:1787862357.842869:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787862357.842876:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.842883:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cd9ec3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862357.843156:0:5871:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787862357.843428:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787862357.843442:0:5871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 408878400966ns, next at 409878398351ns, rc = 0 00000001:00080000:1.0:1787862357.843450:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787862357.843493:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:1.0:1787862357.843497:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862357.843506:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9eae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05fd expref: 24 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862357.843653:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:10404:x1874709223340928:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 22668us (22999us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787862357.843668:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000020:00080000:1.0:1787862357.843674:0:5871:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787862357.846787:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.846934:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223341184 00000100:00100000:3.0:1787862357.846949:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223341184 00000100:00100000:3.0:1787862357.847068:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:3.0:1787862357.847083:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:10404:x1874709223341184:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862357.847120:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862357.847153:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0604 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.847237:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9eca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0604 expref: 24 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.847256:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9eca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0604 expref: 24 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862357.847280:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862357.847284:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862357.847290:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d000, rc 0) 00000100:00100000:3.0:1787862357.847390:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:10404:x1874709223341184:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 308us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862357.847398:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:2.0:1787862357.850893:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.851007:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223341440 00000100:00100000:1.0:1787862357.851156:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223341440 00000100:00100000:1.0:1787862357.851276:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862357.851289:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:10404:x1874709223341440:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862357.851850:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:10404:x1874709223341440:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 561us (971us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787862357.851861:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1787862357.959232:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862357.959598:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223341696 00000100:00100000:1.0:1787862357.959613:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223341696 00000100:00100000:1.0:1787862357.959870:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1787862357.959884:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:10414:x1874709223341696:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862357.959920:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862357.959954:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c060b expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862357.960397:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787862357.960628:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ed1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c060b expref: 27 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.960648:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:1.0:1787862357.960651:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862357.960657:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c060b expref: 27 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862357.960690:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862357.960780:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10414:x1874709223341696:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 899us (1565us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787862357.960788:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:0.0:1787862357.965859:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.965976:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223341824 00000100:00100000:3.0:1787862357.965990:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223341824 00000100:00100000:2.0:1787862357.966307:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1787862357.966323:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10414:x1874709223341824:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:2.0:1787862357.966586:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.966635:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.966654:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.966687:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.966694:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.966701:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967138:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967148:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967156:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862357.967212:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967228:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967235:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967254:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967261:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862357.967266:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967275:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967290:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862357.967294:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862357.967300:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967307:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cd9edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967320:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967326:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967540:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967548:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862357.967552:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967569:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967579:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a1205e1500) 00010000:00010000:2.0:1787862357.967582:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862357.967585:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967591:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cd9ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967608:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967614:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967620:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967625:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ec00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862357.967628:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967633:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967640:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862357.967642:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862357.967645:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862357.967662:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862357.967803:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10414:x1874709223341824:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 1480us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862357.967814:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1787862357.971534:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862357.971971:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223342080 00000100:00100000:3.0:1787862357.971986:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223342080 00000100:00100000:2.0:1787862357.972653:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1787862357.972667:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10414:x1874709223342080:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862357.973884:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10414:x1874709223342080:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 1210us (2440us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787862357.973898:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1787862358.032191:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862358.032314:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223342336 00000100:00100000:3.0:1787862358.032330:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223342336 00000100:00100000:3.0:1787862358.032469:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:3.0:1787862358.032483:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10417:x1874709223342336:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862358.032520:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862358.032549:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cd9ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0612 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862358.032654:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862358.032689:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862358.032705:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862358.032725:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862358.032732:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862358.032739:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787862358.033328:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787862358.039866:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.039895:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.039913:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862358.039931:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787862358.040112:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040121:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040129:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040151:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862358.040156:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040165:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040181:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862358.040185:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862358.040190:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040197:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cd9efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040213:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040220:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040226:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040231:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862358.040233:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040240:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040259:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a108824200) 00010000:00010000:2.0:1787862358.040262:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862358.040265:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040271:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cd9f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040339:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cd9ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 30 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040357:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 29 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.040375:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862358.040377:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862358.040380:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79ec00, rc 0) 00000100:00100000:2.0:1787862358.040498:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10417:x1874709223342336:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 8017us (8324us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787862358.040509:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:0.0:1787862358.043533:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862358.043667:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223342464 00000100:00100000:1.0:1787862358.043683:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223342464 00000100:00100000:1.0:1787862358.043768:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:1.0:1787862358.043805:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10417:x1874709223342464:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1787862358.043929:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.043955:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.043971:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044008:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044017:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044025:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044033:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862358.044099:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044110:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044125:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862358.044128:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862358.044134:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.044141:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862358.044247:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10417:x1874709223342464:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 446us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862358.044256:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:3.0:1787862358.050396:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862358.050599:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223342720 00000100:00100000:1.0:1787862358.050612:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223342720 00000100:00100000:1.0:1787862358.050694:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:1.0:1787862358.050706:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10417:x1874709223342720:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862358.051090:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+30:10417:x1874709223342720:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 383us (738us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787862358.051099:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00010000:00010000:2.0:1787862358.149033:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862358.388485:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862358.388640:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223342976 00000100:00100000:1.0:1787862358.388654:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223342976 00000100:00100000:1.0:1787862358.388811:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:1.0:1787862358.388825:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+30:10448:x1874709223342976:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1787862358.388864:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862358.388896:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0619 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.389096:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.389114:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.389128:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862358.389166:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787862358.389389:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0619 expref: 33 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.389413:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0619 expref: 32 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.389422:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862358.389425:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862358.389429:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9000, rc 0) 00000100:00100000:1.0:1787862358.389515:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10448:x1874709223342976:12345-192.168.202.9@tcp:101:cat.0 Request processed in 693us (1045us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787862358.389524:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1787862358.400087:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862358.400213:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223343232 00000100:00100000:1.0:1787862358.400226:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223343232 00000100:00100000:1.0:1787862358.400311:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:1.0:1787862358.400324:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10448:x1874709223343232:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:1.0:1787862358.400779:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:10448:x1874709223343232:12345-192.168.202.9@tcp:35:cat.0 Request processed in 456us (754us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787862358.400788:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1787862358.411911:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862358.414998:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223343360 00000100:00100000:0.0:1787862358.415033:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223343360 00000100:00100000:0.0:1787862358.415210:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:0.0:1787862358.415224:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:2355:x1874709223343360:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862358.415248:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862358.415285:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0619 expref: 33 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.415312:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862358.415319:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862358.415436:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:2355:x1874709223343360:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 214us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862358.415444:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:0.0:1787862358.472987:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862358.473211:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223343616 00000100:00100000:1.0:1787862358.473225:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223343616 00000100:00100000:1.0:1787862358.473308:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:1.0:1787862358.473323:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a008389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10454:x1874709223343616:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:1.0:1787862358.473376:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862358.473403:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787862358.473445:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cd9e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05ef expref: 32 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.473468:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862358.473474:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862358.473495:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0620 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.473635:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.473653:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 32 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.473678:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.473727:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 32 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.473743:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 32 pid: 9468 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862358.473760:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246448512:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862358.473892:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105ded300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862358.478743:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246448512:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862358.478791:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862358.479834:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862358.480080:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223343744 00000100:00100000:2.0:1787862358.480090:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223343744 00010000:00010000:2.0:1787862358.480148:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 33 pid: 9468 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862358.480205:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:2.0:1787862358.480217:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:2352:x1874709223343744:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862358.480259:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862358.480268:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 33 pid: 9468 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.480283:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 33 pid: 9468 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.480315:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cd9f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0612 expref: 33 pid: 9468 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.480336:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862358.480342:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.480354:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.480375:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.480416:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862358.480493:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:2352:x1874709223343744:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 277us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862358.480502:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00010000:00010000:0.0:1787862358.480634:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.480644:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862358.480671:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787862358.480918:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 33 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.480938:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 32 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.480947:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862358.480950:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862358.480952:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8a00, rc 0) 00000100:00100000:0.0:1787862358.480983:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a008389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10454:x1874709223343616:12345-192.168.202.9@tcp:101:dd.0 Request processed in 7664us (8014us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787862358.480991:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:2.0:1787862358.485488:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862358.485577:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223344000 00000100:00100000:0.0:1787862358.485591:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223344000 00000100:00100000:0.0:1787862358.485693:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1787862358.485706:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10454:x1874709223344000:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:0.0:1787862358.486167:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.486191:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.486207:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862358.486278:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787862358.486308:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003e6c9e7c reply state 00000000727ac5a1 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862358.486320:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862358.486489:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:10454:x1874709223344000:12345-192.168.202.9@tcp:36:dd.0 Request processed in 783us (1015us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787862358.486498:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000020:00080000:0.0:1787862358.486504:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787862358.493431:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.493457:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.493466:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.493474:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862358.493480:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.493490:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.493516:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862358.493519:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862358.493525:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.493532:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862358.910739:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862358.914292:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223344128 00000100:00100000:1.0:1787862358.914316:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223344128 00000100:00100000:1.0:1787862358.914445:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:1.0:1787862358.914459:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:10468:x1874709223344128:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:1.0:1787862358.914498:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862358.914530:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9f4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0627 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.914663:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.914683:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.914698:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.914718:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.914726:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.914732:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.915180:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.915197:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.915214:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.915263:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862358.915282:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 35 pid: 5869 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862358.915300:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246448640:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862358.915459:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105ded300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862358.927909:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862358.928152:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223344384 00000100:00100000:3.0:1787862358.928164:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223344384 00000100:00100000:3.0:1787862358.928239:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1787862358.928251:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:5595:x1874709223344384:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787862358.928934:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:5595:x1874709223344384:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 682us (1035us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787862358.928944:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1787862358.932859:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246448640:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862358.932908:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862358.939452:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862358.939613:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223344512 00000100:00100000:0.0:1787862358.939628:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223344512 00010000:00010000:0.0:1787862358.939707:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 37 pid: 5869 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862358.939769:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1787862358.939780:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:2353:x1874709223344512:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862358.939799:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862358.939808:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 37 pid: 5869 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.939824:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 37 pid: 5869 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.939854:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cd9f3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0620 expref: 37 pid: 5869 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.939874:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862358.939880:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.939891:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.939901:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862358.939941:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862358.940021:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:2353:x1874709223344512:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 241us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862358.940029:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00010000:00010000:2.0:1787862358.940564:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940589:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862358.940652:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787862358.940658:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862358.940713:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940729:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940804:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940813:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940820:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940826:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862358.940831:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940840:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940853:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862358.940857:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862358.940861:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940878:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940894:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940900:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940906:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940911:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862358.940914:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940920:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940929:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a104fc5500) 00010000:00010000:2.0:1787862358.940931:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862358.940935:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940941:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.940999:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9f4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0627 expref: 36 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.942030:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0627 expref: 35 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862358.942068:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862358.942071:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862358.942074:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9000, rc 0) 00000100:00100000:2.0:1787862358.942147:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:10468:x1874709223344128:12345-192.168.202.9@tcp:101:stat.0 Request processed in 27691us (31424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862358.942157:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:2.0:1787862359.023086:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862359.023417:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223344768 00000100:00100000:0.0:1787862359.023432:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223344768 00000100:00100000:0.0:1787862359.023531:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:0.0:1787862359.023545:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:10474:x1874709223344768:12345-192.168.202.9@tcp:36:truncate.0 00010000:00010000:0.0:1787862359.023630:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862359.023674:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9f64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0627 expref: 35 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.023697:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862359.023703:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862359.024003:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.024022:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.024034:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862359.024345:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787862359.024388:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002f835a42 reply state 000000007d1996f6 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862359.024397:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862359.024584:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:10474:x1874709223344768:12345-192.168.202.9@tcp:36:truncate.0 Request processed in 1039us (1557us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787862359.024593:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000020:00080000:0.0:1787862359.024600:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787862359.028181:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.028232:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.028241:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.028247:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862359.028253:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.028262:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.028286:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862359.028289:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862359.028295:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.028302:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.173262:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862359.216295:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862359.216674:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223344896 00000100:00100000:0.0:1787862359.216689:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223344896 00000100:00100000:0.0:1787862359.216912:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:0.0:1787862359.216924:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:10488:x1874709223344896:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:0.0:1787862359.216957:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862359.216987:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c062e expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.217226:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.217595:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.217610:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.217632:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.217640:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.217647:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218302:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218316:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218324:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862359.218551:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787862359.218558:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862359.218592:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218606:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218629:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218636:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218644:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218651:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862359.218656:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218666:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218681:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:0.0:1787862359.218685:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862359.218691:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218699:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cd9f79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218717:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218857:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218863:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218875:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862359.218878:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218885:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218895:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a116882300) 00010000:00010000:0.0:1787862359.218898:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862359.218902:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218908:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cd9f80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218956:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cd9f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 38 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218973:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 37 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.218982:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862359.218985:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862359.218987:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031a00, rc 0) 00000100:00100000:0.0:1787862359.220689:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:10488:x1874709223344896:12345-192.168.202.9@tcp:101:stat.0 Request processed in 3747us (4392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862359.220706:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1787862359.343433:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.345329:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223345152 00000100:00100000:1.0:1787862359.349875:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223345152 00000100:00100000:1.0:1787862359.350034:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:1.0:1787862359.350067:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:10498:x1874709223345152:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862359.350111:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862359.350142:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0635 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862359.350526:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787862359.350972:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9f8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0635 expref: 39 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.351019:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:1.0:1787862359.351023:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862359.351030:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0635 expref: 39 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.351092:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8200, rc 0) 00000100:00100000:1.0:1787862359.351216:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:10498:x1874709223345152:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1152us (7798us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787862359.351227:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:3.0:1787862359.357203:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862359.357524:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223345408 00000100:00100000:2.0:1787862359.357537:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223345408 00000100:00100000:2.0:1787862359.357622:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:2.0:1787862359.357634:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:10498:x1874709223345408:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862359.358586:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:10498:x1874709223345408:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 946us (1391us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787862359.358600:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:2.0:1787862359.433124:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.433319:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223345664 00000100:00100000:1.0:1787862359.433333:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223345664 00000100:00100000:1.0:1787862359.433432:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:1.0:1787862359.433445:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:10504:x1874709223345664:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862359.433490:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862359.433519:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9f9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c063c expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.433662:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.433679:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 40 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.433691:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.433902:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 40 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.433940:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 40 pid: 5869 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862359.433956:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246448768:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862359.434185:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11029d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862359.438486:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862359.439109:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223345792 00000100:00100000:2.0:1787862359.439123:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223345792 00010000:00010000:2.0:1787862359.439188:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 41 pid: 5869 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862359.439245:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:2.0:1787862359.439258:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+41:2352:x1874709223345792:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862359.439279:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862359.439297:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 41 pid: 5869 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.439312:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 41 pid: 5869 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.439344:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862359.439362:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.439374:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.439383:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.439409:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862359.439505:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+41:2352:x1874709223345792:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 249us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862359.439514:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00010000:00010000:1.0:1787862359.444947:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cd9f87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c062e expref: 40 pid: 5869 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862359.444985:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246448768:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862359.445030:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.445103:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.445111:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862359.445140:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787862359.445390:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9f9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 41 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.445410:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 40 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.445422:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862359.445447:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862359.445453:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8e00, rc 0) 00000100:00100000:1.0:1787862359.445542:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:10504:x1874709223345664:12345-192.168.202.9@tcp:101:bash.0 Request processed in 12098us (12438us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787862359.445553:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:0.0:1787862359.457690:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.457853:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223346048 00000100:00100000:1.0:1787862359.457867:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223346048 00000100:00100000:1.0:1787862359.457959:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:1.0:1787862359.457973:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:10504:x1874709223346048:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:1.0:1787862359.458412:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.458435:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.458450:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862359.458514:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787862359.458544:0:5868:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000251f66e0 reply state 00000000cdc50991 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862359.458554:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862359.458675:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:10504:x1874709223346048:12345-192.168.202.9@tcp:36:bash.0 Request processed in 703us (998us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787862359.458684:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000020:00080000:1.0:1787862359.458690:0:5868:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787862359.462780:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.462805:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.462813:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.462820:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862359.462826:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.462835:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.462858:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862359.462861:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862359.462868:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.462875:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862359.468330:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.469149:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223346176 00000100:00100000:1.0:1787862359.469167:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223346176 00000100:00100000:1.0:1787862359.469251:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:1.0:1787862359.469281:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111135a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+42:10504:x1874709223346176:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862359.469315:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862359.469343:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9fb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0643 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.469464:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.469600:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 43 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.469612:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.469656:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 43 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.469672:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 43 pid: 5870 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862359.469688:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246448896:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862359.469959:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a120664c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862359.480782:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.481432:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c0a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246448896:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862359.481483:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862359.481691:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223346304 00000100:00100000:0.0:1787862359.481701:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223346304 00010000:00010000:0.0:1787862359.481764:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 44 pid: 5870 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862359.481804:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:0.0:1787862359.481836:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:2352:x1874709223346304:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862359.481861:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862359.481870:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 44 pid: 5870 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.481884:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 44 pid: 5870 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.481914:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cd9fa3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c063c expref: 44 pid: 5870 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.481935:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862359.481941:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.481954:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.481964:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862359.482016:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862359.482124:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:2352:x1874709223346304:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 289us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862359.482133:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00010000:00010000:3.0:1787862359.483383:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.483400:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862359.483468:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787862359.483489:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862359.483520:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.483571:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cd9fb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0643 expref: 43 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.483594:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0643 expref: 42 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.483603:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862359.483606:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862359.483609:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9a00, rc 0) 00000100:00100000:3.0:1787862359.483685:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111135a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+42:10504:x1874709223346176:12345-192.168.202.9@tcp:101:bash.0 Request processed in 14405us (15367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862359.483695:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:0.0:1787862359.504723:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862359.504869:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223346560 00000100:00100000:2.0:1787862359.504883:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223346560 00000100:00100000:2.0:1787862359.504964:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1787862359.504976:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+42:10504:x1874709223346560:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1787862359.505392:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:10504:x1874709223346560:12345-192.168.202.9@tcp:35:bash.0 Request processed in 416us (688us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787862359.505403:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:0.0:1787862359.633439:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.633642:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223346816 00000100:00100000:1.0:1787862359.633656:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223346816 00000100:00100000:1.0:1787862359.633757:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:1.0:1787862359.633770:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111136d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:10514:x1874709223346816:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862359.633804:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862359.633834:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c064a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862359.634240:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787862359.634475:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9fc6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c064a expref: 45 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.634495:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:1.0:1787862359.634499:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862359.634506:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c064a expref: 45 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.634522:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9000, rc 0) 00000100:00100000:1.0:1787862359.634617:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111136d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:10514:x1874709223346816:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 849us (1193us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787862359.634626:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1787862359.647235:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862359.648545:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223346944 00000100:00100000:2.0:1787862359.648564:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223346944 00000100:00100000:2.0:1787862359.648685:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:2.0:1787862359.648705:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1207783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:10514:x1874709223346944:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:2.0:1787862359.648810:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.648832:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.648848:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.648866:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.648873:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.648880:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649308:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649320:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649339:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862359.649404:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649418:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649432:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649439:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649446:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fe00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862359.649451:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649459:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649475:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862359.649478:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862359.649483:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649490:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cd9fd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649507:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649514:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649520:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649524:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862359.649535:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649541:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649548:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a1205e1500) 00010000:00010000:2.0:1787862359.649551:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862359.649554:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649560:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cd9fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649575:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649581:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649586:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649591:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ea00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862359.649594:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649599:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649606:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862359.649608:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862359.649619:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.649624:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cd9fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862359.649752:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1207783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:10514:x1874709223346944:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 1047us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862359.649764:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:2.0:1787862359.659739:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.659863:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223347200 00000100:00100000:1.0:1787862359.659878:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223347200 00000100:00100000:1.0:1787862359.659957:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862359.659969:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:10514:x1874709223347200:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862359.660696:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:10514:x1874709223347200:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 727us (972us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787862359.660707:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1787862359.750543:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.750694:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223347456 00000100:00100000:1.0:1787862359.750712:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223347456 00000100:00100000:1.0:1787862359.750802:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:1.0:1787862359.750815:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:10517:x1874709223347456:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862359.750852:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862359.750883:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9fe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0651 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751007:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751027:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751086:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751106:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751114:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751121:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751517:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751529:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751537:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862359.751556:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787862359.751680:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751688:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751695:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751702:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862359.751707:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751716:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751731:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862359.751735:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862359.751741:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751748:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cd9ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751763:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751770:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751787:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751793:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862359.751795:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751801:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751810:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a104fc5b00) 00010000:00010000:1.0:1787862359.751813:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862359.751816:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751822:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cd9ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751879:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cd9fe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0651 expref: 48 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751894:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0651 expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.751902:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862359.751903:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862359.751907:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9400, rc 0) 00000100:00100000:1.0:1787862359.752005:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10517:x1874709223347456:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1192us (1480us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787862359.752024:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:0.0:1787862359.756103:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862359.756316:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223347584 00000100:00100000:3.0:1787862359.756330:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223347584 00000100:00100000:3.0:1787862359.756417:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:3.0:1787862359.756430:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10517:x1874709223347584:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1787862359.756532:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756555:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756572:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756613:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756620:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756628:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756635:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862359.756641:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756650:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756665:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862359.756668:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862359.756674:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.756702:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda00c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862359.756940:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10517:x1874709223347584:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 511us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862359.756950:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:2.0:1787862359.759590:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.760182:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223347840 00000100:00100000:1.0:1787862359.760200:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223347840 00000100:00100000:1.0:1787862359.760337:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:1.0:1787862359.760360:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10517:x1874709223347840:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862359.760932:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:10517:x1874709223347840:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 572us (1356us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787862359.760942:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1787862359.763339:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862359.763549:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223347968 00000100:00100000:2.0:1787862359.763563:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223347968 00000100:00100000:2.0:1787862359.763660:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1787862359.763673:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:2354:x1874709223347968:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862359.763709:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862359.763749:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cd9ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0651 expref: 48 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.763774:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862359.763780:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862359.763858:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:2354:x1874709223347968:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 187us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862359.763867:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1787862359.909106:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.910334:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223348224 00000100:00100000:1.0:1787862359.910366:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223348224 00000100:00100000:1.0:1787862359.910465:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:1.0:1787862359.910494:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10535:x1874709223348224:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1787862359.910531:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862359.910564:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0658 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.910721:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda01a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.910740:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda01a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.910756:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda01a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862359.910772:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787862359.910952:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0658 expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.910999:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda01a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0658 expref: 49 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862359.911008:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862359.911012:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787862359.911017:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862359.911189:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120779a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10535:x1874709223348224:12345-192.168.202.9@tcp:101:cat.0 Request processed in 703us (2154us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787862359.911198:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:0.0:1787862359.941169:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862359.941535:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223348352 00000100:00100000:2.0:1787862359.941548:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223348352 00000100:00100000:2.0:1787862359.941637:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:2.0:1787862359.941651:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10536:x1874709223348352:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862359.941717:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862359.941759:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c065f expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.941855:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda02f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.941874:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.941890:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862359.942496:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787862359.942503:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862359.942598:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.942641:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c065f expref: 51 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.942662:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda02f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c065f expref: 50 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862359.942673:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862359.942676:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862359.942681:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79fe00, rc 0) 00000100:00100000:2.0:1787862359.943226:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10536:x1874709223348352:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1574us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862359.943236:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:3.0:1787862359.953580:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862359.954612:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223348736 00000100:00100000:1.0:1787862359.954631:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223348736 00000100:00100000:1.0:1787862359.954967:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1787862359.954981:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10536:x1874709223348736:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862359.955495:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10536:x1874709223348736:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 515us (1929us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787862359.955504:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1787862359.959189:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862359.959370:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223348864 00000100:00100000:3.0:1787862359.959384:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223348864 00000100:00100000:3.0:1787862359.959475:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1787862359.959489:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10536:x1874709223348864:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:3.0:1787862359.959511:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787862359.959545:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cd9fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0643 expref: 51 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.959572:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda01a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0658 expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.959585:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cd9eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0604 expref: 49 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.959597:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862359.959610:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862359.959683:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:10536:x1874709223348864:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 197us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862359.959692:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1787862359.963286:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862359.963528:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223348992 00000100:00100000:3.0:1787862359.963541:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223348992 00000100:00100000:3.0:1787862359.963653:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:3.0:1787862359.963680:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:10536:x1874709223348992:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:3.0:1787862359.963885:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.963909:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862359.963924:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862359.964708:0:5868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862359.965473:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787862359.965570:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787862359.966595:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:10536:x1874709223348992:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 2914us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862359.966613:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:3.0:1787862360.004623:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.005364:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223349120 00000100:00100000:2.0:1787862360.005381:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223349120 00000100:00100000:2.0:1787862360.005488:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:2.0:1787862360.005503:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:10538:x1874709223349120:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862360.005531:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862360.005559:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda03d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0666 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.005652:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.005685:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.005702:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787862360.005906:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787862360.006438:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.006451:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.006461:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.007641:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.007660:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008195:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862360.008254:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787862360.008261:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862360.008288:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008304:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008315:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008321:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008330:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008336:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862360.008427:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008439:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008454:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862360.008458:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862360.008464:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008482:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008500:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008507:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008513:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008519:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ea00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862360.008522:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008529:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008537:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a1205e1500) 00010000:00010000:2.0:1787862360.008540:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862360.008543:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008549:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ea00/0x391a6cd368cda04b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008597:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda03d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 50 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008614:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 49 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.008630:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:2.0:1787862360.008632:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862360.008635:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e000, rc 0) 00000100:00100000:2.0:1787862360.009582:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10538:x1874709223349120:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 4072us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862360.009596:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000004:00080000:3.0:1787862360.068548:0:6913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411103503961ns, next at 412103500161ns, rc = 0 00000100:00100000:0.0:1787862360.068655:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246449024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862360.068769:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862360.069192:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246449024 00000100:00100000:3.0:1787862360.069203:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246449024 00000100:00100000:3.0:1787862360.069287:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787862360.069308:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3328:x1874709246449024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862360.069378:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862360.069448:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3328:x1874709246449024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862360.069457:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787862360.069557:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862360.069612:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246449024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862360.196686:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862360.324504:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862360.324519:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862360.324594:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787862360.324603:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862360.324936:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246449152:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787862360.325695:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862360.338699:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.340551:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a112c60000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246449152:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862360.342153:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223349248 00000100:00100000:0.0:1787862360.342173:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223349248 00000100:00100000:0.0:1787862360.342262:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1787862360.342276:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349248:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787862360.342435:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349248:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 Request processed in 162us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862360.342445:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1787862360.355829:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.356010:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223349376 00000100:00100000:2.0:1787862360.356025:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223349376 00000100:00100000:2.0:1787862360.356148:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:2.0:1787862360.356162:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349376:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862360.356220:0:9468:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862360.356609:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349376:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 449us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862360.356618:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:3.0:1787862360.374652:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862360.374706:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223349504 00000100:00100000:3.0:1787862360.374731:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223349504 00000100:00100000:3.0:1787862360.374806:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:3.0:1787862360.374819:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349504:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787862360.374942:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379056:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379079:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379116:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379138:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379146:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379245:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379255:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379263:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862360.379323:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787862360.379329:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862360.379358:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379372:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379379:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379387:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379393:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862360.379397:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379405:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379419:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:3.0:1787862360.379428:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862360.379435:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379441:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda059 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379454:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379460:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379466:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379471:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862360.379474:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379480:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379488:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff89a108824400) 00010000:00010000:3.0:1787862360.379491:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862360.379494:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379501:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda060 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379519:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379531:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379537:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379543:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862360.379546:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379552:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379563:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:3.0:1787862360.379565:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862360.379568:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.379573:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862360.379724:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349504:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 4900us (5082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862360.379737:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1787862360.387687:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862360.387999:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223349760 00000100:00100000:3.0:1787862360.388012:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223349760 00000100:00100000:3.0:1787862360.388104:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:3.0:1787862360.388433:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10549:x1874709223349760:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862360.388464:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862360.388511:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda06e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c066d expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388651:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388670:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388686:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862360.388702:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787862360.388846:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388855:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388862:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388869:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862360.388874:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388883:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388898:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:3.0:1787862360.388902:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862360.388908:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388926:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.388998:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda06e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c066d expref: 51 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.389011:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:3.0:1787862360.389014:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862360.389018:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda06e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c066d expref: 51 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.389029:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c800, rc 0) 00000100:00100000:3.0:1787862360.389434:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10549:x1874709223349760:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1316us (1759us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787862360.389446:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:3.0:1787862360.406168:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.408749:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223349888 00000100:00100000:1.0:1787862360.408774:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223349888 00000100:00100000:1.0:1787862360.408866:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:1.0:1787862360.408879:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10549:x1874709223349888:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862360.408940:0:5869:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862360.409172:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10549:x1874709223349888:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 295us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862360.409180:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:3.0:1787862360.420664:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.420751:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223350144 00000100:00100000:1.0:1787862360.420764:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223350144 00000100:00100000:1.0:1787862360.420840:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:1.0:1787862360.420853:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120581e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10549:x1874709223350144:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862360.420883:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862360.420887:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787862360.420926:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda02f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c065f expref: 50 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.420945:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862360.420951:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862360.420968:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda083 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0674 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862360.421878:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787862360.422180:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda08a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.422198:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.422214:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.422292:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda083 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0674 expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.422312:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda08a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0674 expref: 51 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.422337:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862360.422354:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862360.422358:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9400, rc 0) 00000100:00100000:1.0:1787862360.422467:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120581e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10549:x1874709223350144:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1615us (1815us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787862360.422477:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:1.0:1787862360.442253:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.442392:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223350400 00000100:00100000:2.0:1787862360.442407:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223350400 00000100:00100000:2.0:1787862360.442487:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:2.0:1787862360.442499:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10549:x1874709223350400:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862360.442577:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862360.442612:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda08a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0674 expref: 51 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.442637:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862360.442662:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862360.442699:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.442717:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.442732:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.442904:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.442928:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.442942:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443302:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443310:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443317:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443323:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862360.443328:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443335:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443374:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862360.443377:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862360.443384:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443391:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda098 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443404:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443410:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443416:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443421:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862360.443425:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443432:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443441:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xda37b21f (ffff89a1205e1500) 00010000:00010000:2.0:1787862360.443444:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862360.443447:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.443453:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda09f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda37b21f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862360.443599:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10549:x1874709223350400:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1096us (1356us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862360.443610:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:2.0:1787862360.456493:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.456618:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223350528 00000100:00100000:1.0:1787862360.456628:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223350528 00000100:00100000:1.0:1787862360.456712:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1787862360.456723:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10549:x1874709223350528:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862360.456749:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862360.456779:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda0a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c067b expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.456825:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.456840:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.456854:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.456967:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda0a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.456996:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 51 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862360.457004:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:1.0:1787862360.457007:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787862360.457010:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8200, rc 0) 00000100:00100000:1.0:1787862360.457106:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10549:x1874709223350528:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 385us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862360.457115:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:3.0:1787862360.466850:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.466935:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223350784 00000100:00100000:2.0:1787862360.466954:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223350784 00000100:00100000:2.0:1787862360.467097:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:2.0:1787862360.467109:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10549:x1874709223350784:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862360.467214:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.467235:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.467248:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862360.467616:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787862360.467627:0:5869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411502585970ns, next at 412502583753ns, rc = 0 00000004:00010000:2.0:1787862360.467734:0:5869:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003c655370 reply state 000000002bef79ec transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862360.467745:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862360.467853:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1205821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:10549:x1874709223350784:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 745us (1019us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787862360.467860:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00010000:00010000:3.0:1787862360.472246:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.472268:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.472277:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.472283:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862360.472306:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.472316:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.472350:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:3.0:1787862360.472354:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787862360.472360:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.472367:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda0b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862360.479706:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.480901:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223350912 00000100:00100000:0.0:1787862360.480918:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223350912 00000100:00100000:0.0:1787862360.481013:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:0.0:1787862360.481024:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:10549:x1874709223350912:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862360.481074:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862360.481100:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0682 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.481195:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.481213:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.481235:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:0.0:1787862360.481238:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862360.481244:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030c00, rc 0) 00000100:00100000:0.0:1787862360.481331:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:10549:x1874709223350912:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 309us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862360.481347:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:2.0:1787862360.484484:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.484622:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223351040 00000100:00100000:1.0:1787862360.484635:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223351040 00000100:00100000:1.0:1787862360.484807:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1787862360.484843:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1874709223351040:12345-192.168.202.9@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787862360.484891:0:9223:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1787862360.484941:0:9223:0:(genops.c:1385:class_connect()) connect: client c20d7abe-3b31-4da4-909a-c5bb95bfc247, cookie 0x391a6cd368cda0c2 00002000:00100000:1.0:1787862360.484971:0:9223:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c20d7abe-3b31-4da4-909a-c5bb95bfc247/ffff89a13d571800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787862360.485326:0:9223:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787862360.485643:0:9223:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787862360.485687:0:9223:0:(import.c:65:import_set_state_nolock()) ffff89a13d573000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862360.485899:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2351:x1874709223351040:12345-192.168.202.9@tcp:8:lhsmtool_posix.0 Request processed in 1054us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862360.485911:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:3.0:1787862360.492647:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.492736:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223351168 00000100:00100000:0.0:1787862360.492749:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223351168 00000100:00100000:0.0:1787862360.492833:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:0.0:1787862360.492845:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:0:x1874709223351168:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787862360.493192:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787862360.633698:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1787862360.634327:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:0:x1874709223351168:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 141472us (141681us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787862360.634355:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000001:00100000:1.0:1787862360.634469:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000100:00100000:3.0:1787862360.644856:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.645447:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223351424 00000100:00100000:0.0:1787862360.645462:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223351424 00000100:00100000:0.0:1787862360.645553:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1787862360.645566:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:10549:x1874709223351424:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787862360.658597:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10549:x1874709223351424:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 13013us (13738us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787862360.658618:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1787862360.679541:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.679690:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223351680 00000100:00100000:1.0:1787862360.679704:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223351680 00000100:00100000:1.0:1787862360.679796:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:1.0:1787862360.679809:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10549:x1874709223351680:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787862360.679961:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10549:x1874709223351680:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 154us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862360.679969:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:3.0:1787862360.683312:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.683521:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223351808 00000100:00100000:0.0:1787862360.683535:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223351808 00000100:00100000:0.0:1787862360.683619:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:0.0:1787862360.683632:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10549:x1874709223351808:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862360.683665:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862360.683697:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda0c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0689 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.683809:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda0d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.683828:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.683843:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862360.683891:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862360.683916:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.683950:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda0c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0689 expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.683973:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0689 expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.683983:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:0.0:1787862360.683986:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787862360.683991:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031a00, rc 0) 00000100:00100000:0.0:1787862360.684147:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10549:x1874709223351808:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 518us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862360.684156:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:3.0:1787862360.691065:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.691501:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223351936 00000100:00100000:0.0:1787862360.691516:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223351936 00000100:00100000:0.0:1787862360.691600:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1787862360.691612:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223351936:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862360.691638:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862360.691665:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0690 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862360.691702:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909d58, blocks: 0x1 00010000:00010000:0.0:1787862360.691746:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1787862360.691753:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862360.691765:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.691789:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.691806:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031600, rc 0) 00000100:00100000:0.0:1787862360.691894:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223351936:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 283us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862360.691902:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1787862360.696873:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.696963:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223352192 00000100:00100000:1.0:1787862360.696976:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223352192 00000100:00100000:1.0:1787862360.697106:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:1.0:1787862360.697120:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10549:x1874709223352192:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787862360.697262:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10549:x1874709223352192:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 145us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862360.697271:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:3.0:1787862360.701162:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.701280:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223352320 00000100:00100000:0.0:1787862360.701322:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223352320 00000100:00100000:0.0:1787862360.701411:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:0.0:1787862360.701423:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:10549:x1874709223352320:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862360.701451:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862360.701480:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0697 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.701528:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.701562:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862360.701569:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862360.701576:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.701624:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.701642:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862360.701660:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1874709246449280:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862360.701785:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862360.711783:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.711912:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1874709246449280:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862360.711982:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862360.712023:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142161000, rc 0) 00000100:00100000:2.0:1787862360.712132:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10549:x1874709223352320:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 10710us (10988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862360.712145:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1787862360.712497:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223352448 00000100:00100000:3.0:1787862360.712508:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223352448 00010000:00010000:3.0:1787862360.712562:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862360.712607:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1787862360.712618:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223352448:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862360.712637:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862360.712683:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.712729:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.712768:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cda0d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0690 expref: 7 pid: 6709 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.712789:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862360.712794:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862360.712805:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.712819:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.712866:0:5855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862360.712884:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b29680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5855:1874709246449408:192.168.202.9@tcp:105: 00000100:00100000:3.0:1787862360.712961:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862360.722539:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b29680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5855:1874709246449408:192.168.202.9@tcp:105: 00010000:00010000:3.0:1787862360.722585:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862360.722679:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223352448:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 10060us (10910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862360.722695:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1787862360.725232:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862360.725481:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223352576 00000100:00100000:0.0:1787862360.725497:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223352576 00002000:00100000:0.0:1787862360.725579:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff89a141b29680 x1874709223352576/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:476/0 lens 504/0 e 0 to 0 dl 1787862371 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862360.725617:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a141b29680 with x1874709223352576 ext(0->8) 00002000:00010000:0.0:1787862360.725625:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a141b29680 00000100:00100000:0.0:1787862360.725672:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1787862360.725685:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223352576:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787862360.729703:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2354:x1874709223352576:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 4008us (4482us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787862360.729723:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00002000:00100000:0.0:1787862360.729740:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff89a141b29680 x1874709223352576/t4294967302(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:476/0 lens 504/448 e 0 to 0 dl 1787862371 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862360.732290:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a141b29680 with x1874709223352576 ext(0->8) 00002000:00010000:0.0:1787862360.732311:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a141b29680 00000100:00100000:1.0:1787862360.745562:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862360.745668:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223352704 00000100:00100000:2.0:1787862360.745682:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223352704 00000100:00100000:2.0:1787862360.745768:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:2.0:1787862360.745781:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10549:x1874709223352704:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787862360.897177:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787862360.897289:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1787862360.897316:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1787862360.897354:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787862360.897370:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a107ee59c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787862360.897378:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a112f14f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a107ee5300 00000020:00080000:0.0:1787862360.897382:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a112f14600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a13d364000 00000020:00080000:0.0:1787862360.897626:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787862360.897817:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787862360.897841:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246449536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787862360.897942:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10549:x1874709223352704:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 152159us (152392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862360.897957:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:0.0:1787862360.898400:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862360.898420:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246449664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787862360.898487:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246449536 00000100:00100000:0.0:1787862360.898514:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246449536 00000100:00100000:0.0:1787862360.898565:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862360.898575:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246449536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787862360.898603:0:6709:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787862360.898642:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a909d55, atime: 0x6a909d56, ctime: 0x6a909d55, blocks: 0xb 00010000:00010000:0.0:1787862360.898652:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.898671:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1787862360.898676:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862360.898685:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.898705:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.898715:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.898723:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.898743:0:6709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787862360.899427:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3329:x1874709246449536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 851us (1026us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787862360.899436:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787862360.899470:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862360.899488:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.899502:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862360.899508:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.899518:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.899540:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.899548:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda0e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.899567:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862360.899569:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862360.899571:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787862360.899605:0:3329:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13c1a7840/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787862360.899612:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246449536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787862360.899698:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862360.899864:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246449664 00000100:00100000:3.0:1787862360.899870:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246449664 00000100:00100000:3.0:1787862360.900009:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862360.900021:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246449664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787862360.900267:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787862360.900270:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787862361 00002000:00010000:3.0:1787862360.900273:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787862360.900275:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787862360 -> 1787862361 00002000:00010000:3.0:1787862360.900278:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787862360.900320:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246449664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 304us (622us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787862360.900329:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787862360.900764:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787862360.900865:0:3330:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a108674780/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787862360.900873:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246449664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787862360.910315:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862360.910568:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223352832 00000100:00100000:1.0:1787862360.910579:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223352832 00000100:00100000:1.0:1787862360.910648:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1787862360.910664:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2355:x1874709223352832:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787862360.975735:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2355:x1874709223352832:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 65051us (65413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862360.975771:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000001:00080000:0.0:1787862360.979667:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787862360.979724:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787862360.991113:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862360.991981:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223353088 00000100:00100000:3.0:1787862360.991996:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223353088 00000100:00100000:3.0:1787862360.992121:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:3.0:1787862360.992137:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10549:x1874709223353088:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862360.992225:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862360.992265:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda0d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0689 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.992315:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:3.0:1787862360.992323:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862360.992376:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.992394:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862360.992406:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862360.992728:0:5869:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000fb4686d reply state 00000000fb06c8bc transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862360.992740:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862360.992892:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10549:x1874709223353088:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 757us (1856us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787862360.992901:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:2.0:1787862360.996383:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1787862360.996494:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.996532:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.996540:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.996547:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862360.996563:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.996574:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.996597:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:0.0:1787862360.996601:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862360.996607:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862360.996614:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda0ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862361.000912:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223353216 00000100:00100000:3.0:1787862361.000937:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223353216 00000100:00100000:3.0:1787862361.001076:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1787862361.001089:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223353216:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787862361.001804:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787862361.001809:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787862361 -> 1787862359 00002000:00010000:3.0:1787862361.001813:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787862358 00002000:00010000:3.0:1787862361.001816:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787862361 -> 1787862359 00002000:00010000:3.0:1787862361.001818:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787862361.001969:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2354:x1874709223353216:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 880us (5596us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787862361.001979:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1787862361.018879:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862361.019106:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223353472 00000100:00100000:2.0:1787862361.019126:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223353472 00000100:00100000:1.0:1787862361.019513:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:1.0:1787862361.019600:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10549:x1874709223353472:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787862361.019688:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.019708:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.019719:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.019764:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.019779:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 13 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.019796:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246449792:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862361.019981:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862361.028569:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246449792:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862361.028604:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862361.029698:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.030103:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223353600 00000100:00100000:0.0:1787862361.030120:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223353600 00010000:00010000:0.0:1787862361.030284:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.030360:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:0.0:1787862361.030371:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:2353:x1874709223353600:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862361.030390:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862361.030399:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.030414:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.030439:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda0ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c067b expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.030454:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:0.0:1787862361.030460:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.030470:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.030478:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.030500:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862361.031388:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2353:x1874709223353600:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1009us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.031401:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00010000:00010000:1.0:1787862361.031643:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031652:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031683:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031700:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031706:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031712:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862361.031716:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031723:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031737:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:1.0:1787862361.031739:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787862361.031744:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.031750:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda0f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.031808:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:10549:x1874709223353472:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 12283us (12946us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787862361.031816:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:3.0:1787862361.037514:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862361.038918:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223353728 00000100:00100000:2.0:1787862361.038937:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223353728 00000100:00100000:2.0:1787862361.039028:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:2.0:1787862361.039060:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2355:x1874709223353728:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787862361.039143:0:9223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.039171:0:9223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.039181:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787862361.039187:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862361.039214:0:9223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.039265:0:9223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.039282:0:9223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 7 pid: 6711 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862361.039316:0:9223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ae580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246449920:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862361.039462:0:9223:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a101254540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862361.051283:0:9223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ae580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246449920:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862361.051362:0:9223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862361.051619:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.053599:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223353856 00000100:00100000:0.0:1787862361.053615:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223353856 00010000:00010000:0.0:1787862361.053676:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 8 pid: 6711 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.053745:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:0.0:1787862361.053760:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223353856:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862361.053783:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862361.053811:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 8 pid: 6711 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.053828:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 8 pid: 6711 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.053862:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fda7939/0x391a6cd368cda0de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0697 expref: 8 pid: 6711 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.053886:0:5854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862361.053892:0:5854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862361.053899:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.053909:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.053961:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862361.054033:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223353856:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 276us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.055965:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00010000:00010000:0.0:1787862361.056140:0:9223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056155:0:9223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056194:0:9223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056202:0:9223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056210:0:9223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056218:0:9223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862361.056223:0:9223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056232:0:9223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056280:0:9223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.056289:0:9223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d34330a/0x391a6cd368cda0fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.058149:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223353728:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 19095us (20635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.058165:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:0.0:1787862361.080625:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.080784:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223354112 00000100:00100000:1.0:1787862361.080799:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223354112 00000100:00100000:1.0:1787862361.080906:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:1.0:1787862361.080921:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:10549:x1874709223354112:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862361.081084:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081127:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081144:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081644:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081662:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081673:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081719:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.081736:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 13 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.081754:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246450048:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862361.081879:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e556c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862361.093908:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246450048:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862361.093954:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.114558:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.115448:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223354240 00000100:00100000:0.0:1787862361.115470:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223354240 00010000:00010000:0.0:1787862361.115547:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.115610:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1787862361.115623:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:2353:x1874709223354240:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862361.115652:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862361.115662:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.115680:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.115716:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda0bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0682 expref: 14 pid: 5868 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.115756:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:0.0:1787862361.115763:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.115773:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.115782:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.115818:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862361.115913:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2353:x1874709223354240:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 291us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.115923:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00010000:00010000:1.0:1787862361.116011:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.116020:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862361.116349:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787862361.116540:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787862361.116596:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787862361.116711:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108670b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246450176:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787862361.116819:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862361.116873:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ec0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862361.125653:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246450176 00000100:00100000:0.0:1787862361.125681:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246450176 00000100:00100000:0.0:1787862361.125812:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862361.125828:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874709246450176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787862361.126117:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874709246450176:12345-0@lo:1000:mdt00_001.0 Request processed in 292us (9296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.126128:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862361.126368:0:5869:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787862361.126378:0:5869:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a108674780, transno 4294967303 00000100:00100000:1.0:1787862361.126400:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108670b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246450176:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787862361.127257:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787862361.127404:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108670b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246450304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787862361.127487:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862361.127529:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862361.128091:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246450304 00000100:00100000:0.0:1787862361.128101:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246450304 00000100:00100000:0.0:1787862361.128149:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862361.128160:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874709246450304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787862361.128436:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5869:x1874709246450304:12345-0@lo:1000:mdt00_001.0 Request processed in 277us (947us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787862361.128459:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862361.133362:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108670b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246450304:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787862361.133448:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133461:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133471:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133477:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862361.133483:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133492:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133511:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a104fc5200) 00010000:00010000:3.0:1787862361.133515:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862361.133521:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133527:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda108 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133597:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133604:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133611:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133616:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862361.133619:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133625:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133634:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:3.0:1787862361.133637:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862361.133640:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133646:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda036 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133702:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133720:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133745:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133799:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.133818:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 16 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862361.133836:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246450432:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862361.133976:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862361.147827:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.147873:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223354368 00000100:00100000:1.0:1787862361.147887:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223354368 00010000:00010000:1.0:1787862361.147951:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 17 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.148010:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1787862361.148024:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:2352:x1874709223354368:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862361.148089:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862361.148106:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 17 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.148127:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 17 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.148166:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:1.0:1787862361.148172:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.148184:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.148193:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.148216:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862361.148304:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:2352:x1874709223354368:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 283us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.148313:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00010000:00010000:0.0:1787862361.150568:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0666 expref: 16 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.150605:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246450432:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862361.150642:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150655:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150662:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150681:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150691:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150700:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150709:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862361.150715:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150725:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150744:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:0.0:1787862361.150768:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862361.150775:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150782:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda10f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150797:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150803:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150809:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150815:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862361.150818:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150824:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150833:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a108824800) 00010000:00010000:0.0:1787862361.150835:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787862361.150838:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.150845:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.152725:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10549:x1874709223354112:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 71790us (72099us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787862361.152757:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00000020:00080000:0.0:1787862361.152767:0:5869:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787862361.153001:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862361.153007:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862361.153825:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787862361.153835:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862361.174584:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862361.175575:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223354624 00000100:00100000:3.0:1787862361.175593:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223354624 00000100:00100000:3.0:1787862361.175697:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:3.0:1787862361.175711:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10549:x1874709223354624:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787862361.177354:0:5872:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787862361.177689:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787862361.178974:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.180700:0:5872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.180840:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.180856:0:5872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.180864:0:5872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862361.180884:0:5872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.180987:0:5872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787862361.181207:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:10549:x1874709223354624:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 5492us (6633us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787862361.181219:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000020:00080000:1.0:1787862361.181227:0:5872:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787862361.185776:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862361.185799:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.185815:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862361.185820:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.185833:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.185860:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89a108824f00) 00010000:00010000:2.0:1787862361.185863:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787862361.185871:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.185878:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda116 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.185918:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862361.185920:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862361.185922:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862361.222447:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862361.301120:0:12068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862361.301135:0:12068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862361.301182:0:12068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787862361.301189:0:12068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862361.455824:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.455884:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.455924:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.455954:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.456000:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.456067:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223355008 00000100:00100000:0.0:1787862361.456080:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223355008 00000100:00100000:0.0:1787862361.456168:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223355136 00000100:00100000:0.0:1787862361.456181:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223355136 00000100:00100000:0.0:1787862361.456209:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:0.0:1787862361.456220:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223355008:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862361.456501:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223354752 00000100:00100000:1.0:1787862361.456507:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223354752 00000100:00100000:1.0:1787862361.456548:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 296 00000100:00100000:1.0:1787862361.456557:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223354752:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862361.456639:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223354752:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 82us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.456648:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 296 00000100:00100000:1.0:1787862361.456692:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223355264 00000100:00100000:1.0:1787862361.456696:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223355264 00000100:00100000:1.0:1787862361.456732:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223354880 00000100:00100000:1.0:1787862361.456735:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223354880 00000100:00100000:1.0:1787862361.456761:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 159 00000100:00100000:1.0:1787862361.456768:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223355264:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862361.456801:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223355264:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 34us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.456808:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 159 00000100:00100000:1.0:1787862361.456820:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00100000:1.0:1787862361.456826:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:2355:x1874709223354880:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862361.456856:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:2355:x1874709223354880:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 30us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.456863:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00100000:1.0:1787862361.456885:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:1.0:1787862361.456893:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223355136:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862361.456920:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223355136:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 28us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.456927:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:0.0:1787862361.457418:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223355008:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 1197us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.457426:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00080000:0.0:1787862361.457460:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862361.457466:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862361.464436:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.464880:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223355520 00000100:00100000:1.0:1787862361.464894:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223355520 00000100:00100000:1.0:1787862361.464984:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:1.0:1787862361.465013:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:10559:x1874709223355520:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862361.465062:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862361.465091:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda11d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c069e expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.465602:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda124 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.465622:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda124 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.465637:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda124 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862361.465650:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787862361.468656:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda11d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c069e expref: 20 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.468695:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda124 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c069e expref: 19 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.468707:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862361.468710:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862361.468715:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8200, rc 0) 00000100:00100000:1.0:1787862361.468825:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10559:x1874709223355520:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 3813us (4404us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787862361.468834:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:2.0:1787862361.477430:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.477573:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223355648 00000100:00100000:0.0:1787862361.477586:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223355648 00000100:00100000:0.0:1787862361.477663:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:0.0:1787862361.477675:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10559:x1874709223355648:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:0.0:1787862361.477799:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.477821:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.477836:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.477853:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.477860:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.477867:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478430:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478441:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478448:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862361.478503:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478527:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478534:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478542:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478548:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862361.478553:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478562:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478578:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:0.0:1787862361.478581:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862361.478588:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478595:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478610:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478617:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478622:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478634:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862361.478636:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478642:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478650:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a116882300) 00010000:00010000:0.0:1787862361.478653:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862361.478656:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478662:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478681:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478688:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478694:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478700:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142161000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862361.478702:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478709:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478728:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a116882d00) 00010000:00010000:0.0:1787862361.478730:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862361.478733:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.478739:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.478849:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10559:x1874709223355648:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 1171us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.478860:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:0.0:1787862361.598989:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.599103:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223355904 00000100:00100000:1.0:1787862361.599116:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223355904 00000100:00100000:1.0:1787862361.599212:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:1.0:1787862361.599224:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10562:x1874709223355904:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862361.599253:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862361.599282:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06a5 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.599401:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.599432:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.599448:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.599467:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.599475:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.599482:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600098:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600111:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600120:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862361.600145:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787862361.600273:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600282:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600290:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600296:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862361.600301:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600309:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600323:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862361.600326:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862361.600348:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600355:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda14e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600370:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600376:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600392:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600397:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862361.600400:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.600407:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.603189:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a104fc5100) 00010000:00010000:1.0:1787862361.603204:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862361.603217:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.603230:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.603342:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 22 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.603361:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 21 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.603369:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:1.0:1787862361.603371:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862361.603375:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8e00, rc 0) 00000100:00100000:1.0:1787862361.603877:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10562:x1874709223355904:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 4652us (4900us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787862361.603904:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:3.0:1787862361.609664:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.609885:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223356032 00000100:00100000:1.0:1787862361.609902:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223356032 00000100:00100000:1.0:1787862361.609988:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:1.0:1787862361.610001:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10562:x1874709223356032:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1787862361.610143:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610166:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610181:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610215:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610223:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610232:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610239:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862361.610245:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610254:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610268:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:1.0:1787862361.610284:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862361.610291:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.610299:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda16a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.610411:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10562:x1874709223356032:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 411us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.610420:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:3.0:1787862361.613681:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.613773:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223356288 00000100:00100000:0.0:1787862361.613787:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223356288 00000100:00100000:0.0:1787862361.613864:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1787862361.613876:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10562:x1874709223356288:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1787862361.614246:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:10562:x1874709223356288:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 370us (581us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787862361.614256:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1787862361.724467:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.724554:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223356544 00000100:00100000:1.0:1787862361.724568:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223356544 00000100:00100000:1.0:1787862361.724650:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:1.0:1787862361.724663:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:10091:x1874709223356544:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862361.724698:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862361.724737:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda171 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06ac expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.724874:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.724892:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 23 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.724903:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.724945:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 23 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.724995:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 23 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.725013:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbeb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246450560:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862361.725190:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b9709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862361.739030:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbeb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246450560:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862361.739113:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862361.739341:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.739437:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223356672 00000100:00100000:0.0:1787862361.739446:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223356672 00010000:00010000:0.0:1787862361.739501:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 24 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862361.739577:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:0.0:1787862361.739589:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:2353:x1874709223356672:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862361.739609:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862361.739617:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 24 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.739631:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 24 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.739662:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda15c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06a5 expref: 24 pid: 5870 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.739680:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:0.0:1787862361.739685:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.739694:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.739702:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.740308:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862361.740404:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:2353:x1874709223356672:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 812us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862361.740416:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00010000:00010000:2.0:1787862361.740499:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.740508:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862361.740533:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787862361.740759:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda171 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 24 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.740780:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 23 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.740788:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:2.0:1787862361.740791:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862361.740794:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8400, rc 0) 00000100:00100000:2.0:1787862361.740823:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:10091:x1874709223356544:12345-192.168.202.9@tcp:101:bash.0 Request processed in 16164us (16371us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787862361.740830:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:3.0:1787862361.744411:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.747624:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223356928 00000100:00100000:1.0:1787862361.747647:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223356928 00000100:00100000:1.0:1787862361.747759:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:1.0:1787862361.747771:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:10091:x1874709223356928:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:1.0:1787862361.748390:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.748645:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.748674:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862361.748765:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787862361.748798:0:5868:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001d7ee38b reply state 000000000e88c763 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.748809:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787862361.748872:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787862361.749034:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10091:x1874709223356928:12345-192.168.202.9@tcp:36:bash.0 Request processed in 1261us (4636us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787862361.749076:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000020:00080000:1.0:1787862361.749083:0:5868:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787862361.752119:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1787862361.752246:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.752283:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.752292:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.752299:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862361.752306:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.752315:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.752353:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:0.0:1787862361.752357:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862361.752365:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.752371:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda186 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862361.753401:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223357056 00000100:00100000:2.0:1787862361.753429:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223357056 00000100:00100000:2.0:1787862361.753516:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:2.0:1787862361.753528:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120583840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10091:x1874709223357056:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862361.753555:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862361.753594:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda18d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06b3 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.753677:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda18d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06b3 expref: 27 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.753694:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda18d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06b3 expref: 27 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.753840:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:2.0:1787862361.753845:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862361.753849:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79fc00, rc 0) 00000100:00100000:2.0:1787862361.753995:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120583840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10091:x1874709223357056:12345-192.168.202.9@tcp:101:bash.0 Request processed in 467us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862361.754003:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:3.0:1787862361.758959:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.763227:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223357184 00000100:00100000:1.0:1787862361.763249:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223357184 00000100:00100000:1.0:1787862361.763380:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:1.0:1787862361.763395:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:10091:x1874709223357184:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862361.763657:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862361.763691:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06ba expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862361.763739:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a909d57, atime: 0x6a909d56, ctime: 0x6a909d57, blocks: 0xb 00010000:00010000:1.0:1787862361.763771:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787862361.763776:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862361.763789:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.763809:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.763825:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9000, rc 0) 00000100:00100000:1.0:1787862361.763923:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10091:x1874709223357184:12345-192.168.202.9@tcp:101:bash.0 Request processed in 531us (4979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.763932:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:3.0:1787862361.766950:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862361.769776:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223357312 00000100:00100000:2.0:1787862361.769796:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223357312 00002000:00010000:2.0:1787862361.769863:0:6715:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787862361.769871:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a111134f00 with x1874709223357312 ext(0->18446744073709551615) 00002000:00010000:2.0:1787862361.769891:0:6715:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a111134f00. 00000100:00100000:2.0:1787862361.769950:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:2.0:1787862361.769964:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111134f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223357312:12345-192.168.202.9@tcp:10:bash.0 00002000:00010000:2.0:1787862361.770463:0:6715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787862361.770469:0:6715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787862359 -> 1787862362 00002000:00010000:2.0:1787862361.770473:0:6715:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787862358 -> 1787862358 00002000:00010000:2.0:1787862361.770475:0:6715:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787862359 -> 1787862362 00002000:00010000:2.0:1787862361.770477:0:6715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787862361.770581:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111134f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223357312:12345-192.168.202.9@tcp:10:bash.0 Request processed in 620us (3646us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787862361.770590:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00002000:00010000:2.0:1787862361.770594:0:6715:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787862361.770596:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a111134f00 with x1874709223357312 ext(0->18446744073709551615) 00002000:00010000:2.0:1787862361.770601:0:6715:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a111134f00. 00000100:00100000:3.0:1787862361.846446:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.846770:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223357440 00000100:00100000:0.0:1787862361.846783:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223357440 00000100:00100000:0.0:1787862361.846851:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:0.0:1787862361.846862:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10576:x1874709223357440:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:0.0:1787862361.846977:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.846999:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.847070:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.847093:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.847101:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862361.847109:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.847836:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848696:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848715:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862361.848771:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848785:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848793:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848800:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848807:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862361.848810:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848818:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.848844:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862361.848847:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862361.849054:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849062:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda19b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849082:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849088:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849094:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849099:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862361.849102:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849108:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849116:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a116882d00) 00010000:00010000:2.0:1787862361.849118:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862361.849121:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849127:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda1a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849155:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849161:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849166:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849171:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ec00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862361.849173:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849179:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849186:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:2.0:1787862361.849189:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862361.849192:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.849198:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862361.849410:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10576:x1874709223357440:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 2543us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862361.849422:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:0.0:1787862361.893102:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862361.893226:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223357696 00000100:00100000:2.0:1787862361.893237:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223357696 00000100:00100000:2.0:1787862361.893299:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:2.0:1787862361.893361:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:10579:x1874709223357696:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862361.893386:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862361.893411:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06c1 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893492:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893510:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893525:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893541:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893548:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893555:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893917:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda1c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893927:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.893935:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862361.893956:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787862361.894081:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894090:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894097:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894103:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862361.894108:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894115:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894127:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862361.894130:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862361.894134:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894141:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda1b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894154:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894161:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894176:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894181:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ee00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862361.894184:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894191:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894198:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a1205e1500) 00010000:00010000:2.0:1787862361.894200:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862361.894203:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894208:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda1be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894250:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06c1 expref: 30 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894263:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06c1 expref: 29 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.894271:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:2.0:1787862361.894273:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787862361.894275:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e200, rc 0) 00000100:00100000:2.0:1787862361.894355:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10579:x1874709223357696:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1027us (1266us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787862361.894371:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:2.0:1787862361.908394:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.909114:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223357824 00000100:00100000:1.0:1787862361.909133:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223357824 00000100:00100000:1.0:1787862361.909239:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:1.0:1787862361.909254:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10579:x1874709223357824:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1787862361.909372:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.909417:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 29 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.909430:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.909479:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 29 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.909495:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 29 pid: 9468 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.909513:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbea1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5868:1874709246450688:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862361.909644:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970480 going to sleep for 11 seconds 00000100:00100000:1.0:1787862361.914165:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbea1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5868:1874709246450688:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862361.914221:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862361.916932:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862361.917117:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223358080 00000100:00100000:0.0:1787862361.917137:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223358080 00000100:00100000:0.0:1787862361.917225:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:0.0:1787862361.917237:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+30:5596:x1874709223358080:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787862361.917677:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:5596:x1874709223358080:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 439us (759us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787862361.917686:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:3.0:1787862361.923647:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.924310:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223358208 00000100:00100000:1.0:1787862361.924336:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223358208 00010000:00010000:1.0:1787862361.924406:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 31 pid: 9468 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862361.924488:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:1.0:1787862361.924503:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:2353:x1874709223358208:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862361.924528:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862361.924557:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 31 pid: 9468 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.924573:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 31 pid: 9468 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.924604:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda178 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ac expref: 31 pid: 9468 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.924624:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:1.0:1787862361.924630:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.924640:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.924661:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862361.924707:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862361.924795:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+30:2353:x1874709223358208:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 294us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862361.924803:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00010000:00010000:2.0:1787862361.925511:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925526:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925566:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925574:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925582:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925589:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862361.925594:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925603:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925617:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:2.0:1787862361.925621:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862361.925625:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862361.925632:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda1d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862361.925741:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10579:x1874709223357824:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 16488us (17353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862361.925752:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1787862361.935847:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862361.936207:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223358464 00000100:00100000:1.0:1787862361.936221:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223358464 00000100:00100000:1.0:1787862361.936306:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:1.0:1787862361.936318:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:10579:x1874709223358464:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862361.936684:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+30:10579:x1874709223358464:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 367us (854us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787862361.936715:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:3.0:1787862362.080179:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862362.080481:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223358720 00000100:00100000:1.0:1787862362.080496:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223358720 00000100:00100000:1.0:1787862362.080600:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:1.0:1787862362.080612:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+30:10591:x1874709223358720:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1787862362.080646:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862362.080675:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda1da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06c8 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.080817:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.080837:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.080855:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.080874:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.080881:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.080888:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081406:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda1ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081431:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda1ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081439:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda1ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862362.081453:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787862362.081580:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081588:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081595:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081601:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862362.081606:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081614:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081628:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862362.081631:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862362.081636:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081643:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda1e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081657:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081669:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081675:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081681:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862362.081684:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081691:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081699:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a104fc5b00) 00010000:00010000:1.0:1787862362.081703:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862362.081706:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081712:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda1e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081767:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda1da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06c8 expref: 33 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081783:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda1ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06c8 expref: 32 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.081792:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:1.0:1787862362.081795:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862362.081803:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862362.081891:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10591:x1874709223358720:12345-192.168.202.9@tcp:101:cat.0 Request processed in 1281us (1729us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787862362.081900:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00080000:0.0:1787862362.082185:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862362.089315:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862362.089460:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223358976 00000100:00100000:1.0:1787862362.089473:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223358976 00000100:00100000:1.0:1787862362.089545:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1787862362.089554:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10591:x1874709223358976:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:1.0:1787862362.089876:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:10591:x1874709223358976:12345-192.168.202.9@tcp:35:cat.0 Request processed in 322us (578us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787862362.089883:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1787862362.116840:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246450816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.116963:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862362.117033:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246451328:0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.117095:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862362.117127:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862362.117134:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246450944:0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.117159:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862362.117177:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246451456:0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.117205:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862362.117238:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246451328 00000100:00100000:2.0:1787862362.117247:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246451328 00000100:00100000:2.0:1787862362.117317:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246450944 00000100:00100000:2.0:1787862362.117321:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246450944 00000100:00100000:2.0:1787862362.117363:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787862362.117374:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246451328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.117437:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246451328:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862362.117446:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787862362.117469:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787862362.117476:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246450944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.117504:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246450944:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862362.117530:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1787862362.117550:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862362.117588:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246450944:0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.117600:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246451328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862362.117734:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246451072:0@lo:400:kworker.0 00000100:00100000:3.0:1787862362.117770:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862362.117799:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862362.117806:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246451200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862362.117832:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862362.118067:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246450816 00000100:00100000:0.0:1787862362.118073:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246450816 00000100:00100000:0.0:1787862362.118116:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787862362.118124:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246450816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862362.118178:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246450816:12345-0@lo:400:kworker.0 Request processed in 55us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.118186:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787862362.118236:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246451456 00000100:00100000:0.0:1787862362.118240:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246451456 00000100:00100000:0.0:1787862362.118276:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246451200 00000100:00100000:0.0:1787862362.118280:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246451200 00000100:00100000:0.0:1787862362.118303:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862362.118309:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246451456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862362.118356:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246451456:12345-0@lo:400:kworker.0 Request processed in 47us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.118362:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862362.118373:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787862362.118379:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3329:x1874709246451200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862362.118413:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3329:x1874709246451200:12345-0@lo:400:kworker.0 Request processed in 34us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.118419:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787862362.118439:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862362.118443:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862362.118528:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246451200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862362.118562:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246451456:0@lo:400:kworker.0 00000100:00100000:3.0:1787862362.118572:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246450816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.118826:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246451072 00000100:00100000:2.0:1787862362.118831:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246451072 00000100:00100000:2.0:1787862362.118887:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787862362.118894:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246451072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862362.118944:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246451072:12345-0@lo:400:kworker.0 Request processed in 51us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862362.118950:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787862362.119034:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246451072:0@lo:400:kworker.0 00000100:00080000:0.0:1787862362.120252:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862362.130171:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.130339:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223359232 00000100:00100000:2.0:1787862362.130354:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223359232 00000100:00100000:2.0:1787862362.130455:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:2.0:1787862362.130468:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:10592:x1874709223359232:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:2.0:1787862362.130583:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787862362.130625:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda1ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06c8 expref: 33 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130656:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda1c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06c1 expref: 32 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130669:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda18d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06b3 expref: 31 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130682:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a104fc5400) 00010000:00010000:2.0:1787862362.130719:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862362.130747:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130765:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130779:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130800:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130807:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.130814:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.131319:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.131345:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.131352:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862362.132247:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787862362.132261:0:5870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413167220024ns, next at 414167216737ns, rc = 0 00010000:00010000:2.0:1787862362.132358:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.132385:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.132396:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.132404:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.132411:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.132418:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.139359:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862362.139966:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.139984:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.139993:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140000:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862362.140006:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140016:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140099:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a1205e1e00) 00010000:00010000:2.0:1787862362.140104:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787862362.140111:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140118:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda20b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140156:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140163:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140169:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140175:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ec00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862362.140178:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140185:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140204:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862362.140207:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862362.140211:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.140217:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda1fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862362.140241:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008a3fe2b4 reply state 00000000087e2ab2 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862362.140253:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862362.140427:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:10592:x1874709223359232:12345-192.168.202.9@tcp:36:rm.0 Request processed in 9950us (10262us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787862362.140440:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 95 00010000:00010000:1.0:1787862362.140620:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862362.140629:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.140636:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862362.140639:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.140645:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.140656:0:8521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89a1205e1e00) 00010000:00010000:1.0:1787862362.140658:0:8521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862362.140662:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.140668:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda212 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.140698:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862362.140700:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862362.140702:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862362.146347:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.146373:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.146383:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.146390:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ee00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862362.146396:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.146444:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.146469:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a1205e1500) 00010000:00010000:0.0:1787862362.146472:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862362.146478:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.146485:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda204 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862362.194019:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.194369:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223359488 00000100:00100000:2.0:1787862362.194383:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223359488 00000100:00100000:2.0:1787862362.194475:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:2.0:1787862362.194488:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c0a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:10598:x1874709223359488:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862362.194522:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862362.194551:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda219 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06cf expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.194778:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.194798:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.194812:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.194829:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.194837:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.194859:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862362.200893:0:5869:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787862362.201236:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201258:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201274:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201317:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201336:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201345:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201352:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862362.201357:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201366:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201382:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862362.201385:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862362.201398:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.201406:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cda220 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862362.204604:0:5869:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000041cb1046 reply state 000000003e5917eb transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862362.204632:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787862362.204732:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda219 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 34 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.204759:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 33 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862362.204770:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862362.204773:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862362.204778:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e200, rc 0) 00000100:00100000:2.0:1787862362.204903:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c0a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:10598:x1874709223359488:12345-192.168.202.9@tcp:101:bash.0 Request processed in 10416us (10900us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787862362.204914:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 96 00010000:00010000:1.0:1787862362.212788:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.212815:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.212823:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.212831:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862362.212836:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.212846:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.212869:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a1205e1300) 00010000:00010000:1.0:1787862362.212872:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862362.212879:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.212886:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda227 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862362.214766:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.215189:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223359616 00000100:00100000:0.0:1787862362.215204:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223359616 00000100:00100000:0.0:1787862362.215279:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1787862362.215290:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223359616:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862362.215318:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862362.215362:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06d6 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862362.215400:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862362.215431:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1787862362.215437:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862362.215450:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 6 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.215478:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 6 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.215524:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160200, rc 0) 00000100:00100000:0.0:1787862362.215622:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223359616:12345-192.168.202.9@tcp:101:bash.0 Request processed in 332us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.215630:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:3.0:1787862362.232428:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.232810:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223359744 00000100:00100000:0.0:1787862362.232823:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223359744 00000100:00100000:0.0:1787862362.232902:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:0.0:1787862362.232914:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:10598:x1874709223359744:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862362.232940:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862362.232967:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06dd expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.233013:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.233024:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862362.233030:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862362.233036:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.233135:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.233152:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 7 pid: 6711 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.233191:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874709246451584:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862362.233314:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787862362.241922:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862362.242427:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223359872 00000100:00100000:1.0:1787862362.242442:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223359872 00010000:00010000:1.0:1787862362.242505:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 8 pid: 6711 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862362.242609:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:1.0:1787862362.242622:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223359872:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862362.242655:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862362.242690:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 8 pid: 6711 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.242707:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 8 pid: 6711 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.242745:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862362.242751:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862362.242764:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.242777:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.242835:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862362.242854:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbea1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5853:1874709246451712:192.168.202.9@tcp:105: 00000100:00100000:1.0:1787862362.242974:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13b970600 going to sleep for 11 seconds 00010000:00010000:0.0:1787862362.244629:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cda23c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06d6 expref: 8 pid: 6711 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.244667:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874709246451584:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862362.244707:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.244734:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142161000, rc 0) 00000100:00100000:0.0:1787862362.244822:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:10598:x1874709223359744:12345-192.168.202.9@tcp:101:bash.0 Request processed in 11908us (12422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.244832:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00010000:00010000:0.0:1787862362.247808:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862362.251485:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbea1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5853:1874709246451712:192.168.202.9@tcp:105: 00010000:00010000:1.0:1787862362.251548:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862362.251627:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223359872:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 9006us (9718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862362.251642:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:2.0:1787862362.264120:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862362.264382:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223360128 00000100:00100000:1.0:1787862362.264396:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223360128 00000100:00100000:1.0:1787862362.264489:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1787862362.264500:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:10598:x1874709223360128:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:1.0:1787862362.265013:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:10598:x1874709223360128:12345-192.168.202.9@tcp:35:bash.0 Request processed in 511us (911us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787862362.265023:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:2.0:1787862362.461109:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.461162:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.461436:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223360384 00000100:00100000:3.0:1787862362.461446:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223360384 00000100:00100000:3.0:1787862362.461521:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:3.0:1787862362.461531:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223360384:12345-192.168.202.9@tcp:16:kworker.0 00000100:00100000:3.0:1787862362.461658:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223360384:12345-192.168.202.9@tcp:16:kworker.0 Request processed in 128us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862362.461666:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:0.0:1787862362.461844:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223360256 00000100:00100000:0.0:1787862362.461849:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223360256 00002000:00100000:0.0:1787862362.461876:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89a13d7acf00 x1874709223360256/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:478/0 lens 504/0 e 0 to 0 dl 1787862373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862362.461887:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d7acf00 with x1874709223360256 ext(0->8) 00002000:00010000:0.0:1787862362.461893:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a13d7acf00 00000100:00100000:0.0:1787862362.461916:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:0.0:1787862362.461923:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223360256:12345-192.168.202.9@tcp:4:bash.0 00000100:00100000:0.0:1787862362.462415:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223360256:12345-192.168.202.9@tcp:4:bash.0 Request processed in 490us (1314us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787862362.462428:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00002000:00100000:0.0:1787862362.462436:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89a13d7acf00 x1874709223360256/t4294967302(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:478/0 lens 504/448 e 0 to 0 dl 1787862373 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862362.462445:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d7acf00 with x1874709223360256 ext(0->8) 00002000:00010000:0.0:1787862362.462448:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a13d7acf00 00000100:00100000:3.0:1787862362.475157:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.475384:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223360512 00000100:00100000:0.0:1787862362.475398:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223360512 00000100:00100000:0.0:1787862362.475494:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:0.0:1787862362.475507:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:10614:x1874709223360512:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862362.475548:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862362.475581:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda24a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06e4 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.475682:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.475701:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.475728:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862362.475812:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787862362.475817:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862362.475849:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.475883:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda24a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06e4 expref: 36 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.475927:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06e4 expref: 35 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.475937:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:0.0:1787862362.475941:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862362.475945:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160400, rc 0) 00000100:00100000:0.0:1787862362.476109:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:10614:x1874709223360512:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 603us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.476119:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:2.0:1787862362.484305:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.484424:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223360768 00000100:00100000:3.0:1787862362.484438:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223360768 00000100:00100000:3.0:1787862362.484575:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:3.0:1787862362.484588:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:10614:x1874709223360768:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862362.484621:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862362.484652:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06eb expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.484814:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.484832:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.484848:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862362.484887:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787862362.485308:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06eb expref: 38 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.485339:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06eb expref: 37 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.485348:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862362.485351:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862362.485356:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2ce00, rc 0) 00000100:00100000:3.0:1787862362.485510:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:10614:x1874709223360768:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 924us (1222us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787862362.485520:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:2.0:1787862362.491660:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.494408:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.494957:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361024 00000100:00100000:3.0:1787862362.494984:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361024 00000100:00100000:3.0:1787862362.495099:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:3.0:1787862362.495112:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:2352:x1874709223361024:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862362.495134:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862362.495169:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda25f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06eb expref: 37 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.495194:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862362.495201:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862362.495275:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:2352:x1874709223361024:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 166us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862362.495282:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1787862362.496613:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361152 00000100:00100000:0.0:1787862362.496627:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361152 00000100:00100000:0.0:1787862362.496809:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:0.0:1787862362.496823:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:10614:x1874709223361152:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862362.496854:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862362.496881:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda26d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06f2 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.497466:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda274 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.497489:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.497503:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862362.497520:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787862362.498463:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda26d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f2 expref: 39 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.498491:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f2 expref: 38 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.498502:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:0.0:1787862362.498506:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787862362.498510:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030c00, rc 0) 00000100:00100000:0.0:1787862362.498608:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:10614:x1874709223361152:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1788us (4218us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787862362.498621:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:2.0:1787862362.505085:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.505281:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361280 00000100:00100000:3.0:1787862362.505297:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361280 00000100:00100000:3.0:1787862362.505393:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:3.0:1787862362.505406:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223361280:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:3.0:1787862362.505478:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.505508:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.505519:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862362.505525:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862362.505530:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.505582:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.505601:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 8 pid: 6712 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862362.505621:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1874709246451840:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862362.505747:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862362.511903:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1874709246451840:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862362.511954:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862362.516264:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.518263:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361408 00000100:00100000:3.0:1787862362.518284:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361408 00010000:00010000:3.0:1787862362.518363:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 9 pid: 6712 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862362.518433:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:3.0:1787862362.518445:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2353:x1874709223361408:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862362.518467:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787862362.518498:0:8522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787862362.518502:0:8522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787862362 00002000:00010000:3.0:1787862362.518505:0:8522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787862362 00010000:00010000:3.0:1787862362.518512:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 9 pid: 6712 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.518528:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 9 pid: 6712 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.518560:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cda243 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06dd expref: 9 pid: 6712 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.518582:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862362.518587:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862362.518595:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.518606:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.518668:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862362.518765:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223361408:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 322us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862362.518774:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00010000:00010000:0.0:1787862362.518921:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.518933:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.518964:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.518973:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.518982:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.519003:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862362.519008:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.519019:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.519033:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.519102:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cda282 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.519168:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223361280:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 13766us (14136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.519177:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:3.0:1787862362.528994:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.529223:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361664 00000100:00100000:0.0:1787862362.529241:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361664 00000100:00100000:0.0:1787862362.529342:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1787862362.529359:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:10614:x1874709223361664:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:0.0:1787862362.529469:0:5871:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f2 expref: 38 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862362.529865:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787862362.529916:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787862362.530532:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787862362.530603:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.530627:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 42 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.530638:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.530687:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 42 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.530707:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 42 pid: 5869 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.530726:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f1a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5871:1874709246451968:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862362.530866:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862362.538747:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.538870:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361792 00000100:00100000:3.0:1787862362.538883:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361792 00010000:00010000:3.0:1787862362.538934:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 43 pid: 5869 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862362.538978:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:3.0:1787862362.538996:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:2352:x1874709223361792:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862362.539014:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862362.539022:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 43 pid: 5869 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.539077:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 43 pid: 5869 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.539109:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862362.539116:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.539129:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.539138:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.539163:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862362.539252:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:2352:x1874709223361792:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 264us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862362.539262:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00010000:00010000:0.0:1787862362.540201:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda22e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06cf expref: 42 pid: 5869 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.540228:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f1a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5871:1874709246451968:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862362.540263:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.540273:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.540280:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862362.540500:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787862362.545358:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787862362.545624:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b9792c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246452096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787862362.545721:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862362.545771:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10320d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862362.548847:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246452096 00000100:00100000:0.0:1787862362.548873:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246452096 00000100:00100000:0.0:1787862362.548979:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862362.548993:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5871:x1874709246452096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862362.549372:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5871:x1874709246452096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 382us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.549383:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862362.552082:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b9792c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246452096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787862362.552815:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787862362.552955:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a4f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246452224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787862362.553094:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862362.553145:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862362.554400:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246452224 00000100:00100000:0.0:1787862362.554417:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246452224 00000100:00100000:0.0:1787862362.554504:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862362.554517:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5871:x1874709246452224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862362.554954:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5871:x1874709246452224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 438us (1858us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787862362.554963:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862362.557383:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a4f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246452224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787862362.557847:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787862362.557946:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.557960:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.557969:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.557976:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862362.558335:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.558349:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.558370:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862362.558373:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787862362.558378:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.558402:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda289 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862362.558941:0:5871:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787862362.560000:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787862362.560022:0:5871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413594981292ns, next at 414594975954ns, rc = 0 00000001:00080000:2.0:1787862362.560489:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787862362.560948:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862362.560955:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787862362.560980:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda274 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f2 expref: 46 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862362.561521:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:10614:x1874709223361664:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 32163us (33548us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787862362.561534:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000020:00080000:2.0:1787862362.561542:0:5871:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787862362.565713:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.565877:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223361920 00000100:00100000:0.0:1787862362.565890:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223361920 00000100:00100000:0.0:1787862362.565962:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:0.0:1787862362.565974:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:10614:x1874709223361920:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862362.566007:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862362.566167:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c06f9 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.566265:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f9 expref: 46 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.566310:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f9 expref: 46 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.566347:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862362.566350:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862362.566356:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030e00, rc 0) 00000100:00100000:0.0:1787862362.566436:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+46:10614:x1874709223361920:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 463us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.566444:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:1.0:1787862362.572124:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.579314:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223362176 00000100:00100000:2.0:1787862362.579352:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223362176 00000100:00100000:2.0:1787862362.579465:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:2.0:1787862362.579478:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+46:10614:x1874709223362176:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862362.579868:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10614:x1874709223362176:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 391us (7759us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787862362.579878:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:0.0:1787862362.628776:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13b978780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246452352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862362.628887:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862362.629086:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246452352 00000100:00100000:2.0:1787862362.629113:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246452352 00000100:00100000:2.0:1787862362.629175:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862362.629187:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246452352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862362.629242:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862362.629307:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246452352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862362.629316:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862362.629392:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13b978780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246452352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862362.699429:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.699540:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223362304 00000100:00100000:3.0:1787862362.699556:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223362304 00000100:00100000:3.0:1787862362.699636:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:3.0:1787862362.699647:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10624:x1874709223362304:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1787862362.700098:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700122:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700137:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700176:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700185:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700192:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700370:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700380:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700408:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862362.700470:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700486:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700493:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700502:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700508:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862362.700514:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700522:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700537:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:3.0:1787862362.700541:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862362.700547:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700554:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700571:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700586:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700592:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700596:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862362.700599:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700606:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700613:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a108824400) 00010000:00010000:3.0:1787862362.700616:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862362.700618:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700624:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda29e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700641:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700647:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700654:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700659:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862362.700667:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700674:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700683:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862362.700685:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862362.700688:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.700695:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862362.701713:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10624:x1874709223362304:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 2043us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862362.701729:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:3.0:1787862362.796766:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.805920:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223362560 00000100:00100000:2.0:1787862362.805949:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223362560 00000100:00100000:2.0:1787862362.806121:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:2.0:1787862362.806134:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:10627:x1874709223362560:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862362.806163:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862362.806193:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda2ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0700 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806450:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806472:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806487:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806508:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806515:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806522:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806925:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda2c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806936:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.806943:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862362.806956:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787862362.807119:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807128:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807135:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807142:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862362.807147:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807156:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807183:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:3.0:1787862362.807186:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862362.807194:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807216:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807233:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807239:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807244:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807249:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862362.807252:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807257:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807265:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a108824400) 00010000:00010000:3.0:1787862362.807268:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862362.807271:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807277:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807340:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda2ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0700 expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807358:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0700 expref: 49 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.807373:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862362.807375:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862362.807378:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2ce00, rc 0) 00000100:00100000:3.0:1787862362.807661:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10627:x1874709223362560:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1527us (10908us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787862362.807671:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:3.0:1787862362.819269:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.819687:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223362688 00000100:00100000:0.0:1787862362.819702:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223362688 00000100:00100000:0.0:1787862362.819800:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:0.0:1787862362.819812:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10627:x1874709223362688:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:0.0:1787862362.819924:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.819950:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.819978:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820016:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820081:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820089:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820095:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862362.820101:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820110:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820126:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862362.820129:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862362.820136:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.820142:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.820383:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10627:x1874709223362688:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 570us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862362.820393:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:1.0:1787862362.833399:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862362.833515:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223362944 00000100:00100000:2.0:1787862362.833530:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223362944 00000100:00100000:2.0:1787862362.833613:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1787862362.833625:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:10627:x1874709223362944:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862362.834003:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10627:x1874709223362944:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 379us (618us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787862362.834014:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:1.0:1787862362.954167:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.954325:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223363200 00000100:00100000:0.0:1787862362.954338:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223363200 00000100:00100000:0.0:1787862362.954426:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:0.0:1787862362.954439:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:10637:x1874709223363200:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862362.954474:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862362.954499:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787862362.954539:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06e4 expref: 50 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.954566:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:0.0:1787862362.954573:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862362.954589:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0707 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.954751:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda2dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.954769:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.954782:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862362.954795:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787862362.955921:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0707 expref: 52 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.955950:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda2dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0707 expref: 51 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.955960:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862362.956554:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862362.956565:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031600, rc 0) 00000100:00100000:0.0:1787862362.956990:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10637:x1874709223363200:12345-192.168.202.9@tcp:101:bash.0 Request processed in 2548us (2835us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787862362.957027:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:1.0:1787862362.973175:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862362.973289:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223363456 00000100:00100000:0.0:1787862362.973303:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223363456 00000100:00100000:0.0:1787862362.973396:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00100000:0.0:1787862362.973410:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:10637:x1874709223363456:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:0.0:1787862362.973509:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787862362.973551:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda2dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0707 expref: 51 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.973579:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda2c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0700 expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.973592:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862362.973598:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862362.973906:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.973924:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.973935:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862362.974010:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787862362.974106:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ef86233d reply state 000000001dc19fe0 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862362.974117:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862362.974283:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:10637:x1874709223363456:12345-192.168.202.9@tcp:36:bash.0 Request processed in 870us (1117us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787862362.974293:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 105 00000020:00080000:0.0:1787862362.974301:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787862362.987813:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862362.989067:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223363584 00000100:00100000:3.0:1787862362.989087:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223363584 00000100:00100000:3.0:1787862362.989186:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 106 00000100:00100000:3.0:1787862362.989198:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:10637:x1874709223363584:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1787862362.989231:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862362.989262:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c070e expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.989912:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.989932:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.989944:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.989978:0:5868:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862362.989994:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990197:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990207:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990214:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990221:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862362.990224:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990233:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990263:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862362.990267:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862362.990270:0:3313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990279:0:3313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990286:0:3313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990313:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862362.990345:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda2eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.990736:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.990746:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862362.990807:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787862362.990813:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862362.990839:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.990886:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda2f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.990904:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862362.990914:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862362.990917:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862362.990920:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:1.0:1787862362.991036:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:10637:x1874709223363584:12345-192.168.202.9@tcp:101:bash.0 Request processed in 1838us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862362.991097:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 106 00000100:00100000:1.0:1787862363.003987:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862363.004108:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223363840 00000100:00100000:2.0:1787862363.004123:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223363840 00000100:00100000:2.0:1787862363.004207:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:2.0:1787862363.004220:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:10637:x1874709223363840:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1787862363.004650:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:10637:x1874709223363840:12345-192.168.202.9@tcp:35:bash.0 Request processed in 430us (687us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787862363.004659:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1787862363.121475:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862363.121910:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223363968 00000100:00100000:2.0:1787862363.121926:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223363968 00000100:00100000:2.0:1787862363.122131:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:2.0:1787862363.122145:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:10643:x1874709223363968:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862363.122180:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862363.122209:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda300 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0715 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.122310:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.122344:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.122359:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862363.122450:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787862363.122457:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862363.122496:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.122531:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda300 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0715 expref: 55 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.122575:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0715 expref: 54 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.122585:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862363.122589:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862363.122594:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79ee00, rc 0) 00000100:00100000:2.0:1787862363.124863:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223363968:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 2700us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862363.124884:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:0.0:1787862363.149820:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.150199:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223364096 00000100:00100000:3.0:1787862363.150214:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223364096 00000100:00100000:3.0:1787862363.150296:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:3.0:1787862363.150309:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223364096:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862363.150352:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862363.150383:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda30e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c071c expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150497:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150516:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150529:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150548:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150556:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150562:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150710:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150720:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150748:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862363.150804:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787862363.150809:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862363.150834:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150849:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150858:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150870:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150877:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150884:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862363.150888:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150899:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150913:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:3.0:1787862363.150917:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862363.150924:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150941:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150953:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150960:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150978:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150984:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862363.150987:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.150994:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.151003:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a108824400) 00010000:00010000:3.0:1787862363.151005:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862363.151008:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.151015:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda31c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.151103:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda30e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c071c expref: 56 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.151122:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c071c expref: 55 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.151137:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862363.151140:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862363.151143:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d000, rc 0) 00000100:00100000:3.0:1787862363.151229:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10643:x1874709223364096:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 921us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.151239:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:0.0:1787862363.158878:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.158988:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.159032:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223364480 00000100:00100000:0.0:1787862363.159063:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223364480 00000100:00100000:0.0:1787862363.159158:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1787862363.159170:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:2353:x1874709223364480:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862363.159194:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862363.159237:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c071c expref: 55 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.159267:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862363.159274:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862363.159354:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:2353:x1874709223364480:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 185us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.159363:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1787862363.159551:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223364352 00000100:00100000:0.0:1787862363.159557:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223364352 00000100:00100000:0.0:1787862363.159598:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:0.0:1787862363.159605:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223364352:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862363.159629:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862363.159664:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda32a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0723 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.159822:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.159841:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.159853:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.159897:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.159914:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 55 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.159933:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246452480:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862363.160034:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862363.168294:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.169378:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223364608 00000100:00100000:3.0:1787862363.169555:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223364608 00010000:00010000:3.0:1787862363.169622:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 56 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.169690:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:3.0:1787862363.169702:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:2352:x1874709223364608:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862363.169725:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.169734:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 56 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.169750:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 56 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.169787:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862363.169794:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.169808:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.169839:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.169866:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862363.169956:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:2352:x1874709223364608:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 256us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.169964:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00010000:00010000:3.0:1787862363.170038:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda2f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c070e expref: 55 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.170085:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246452480:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862363.170113:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.170123:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.170128:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862363.170153:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787862363.170369:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda32a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 56 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.170389:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 55 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.170397:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862363.170410:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787862363.170413:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031600, rc 0) 00000100:00100000:3.0:1787862363.170445:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10643:x1874709223364352:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 10839us (11583us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787862363.170453:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:0.0:1787862363.174199:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.174559:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223364864 00000100:00100000:3.0:1787862363.174573:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223364864 00000100:00100000:3.0:1787862363.174741:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862363.174753:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10643:x1874709223364864:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:3.0:1787862363.174774:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.174809:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06f9 expref: 55 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.174831:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862363.174838:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862363.174911:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223364864:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 159us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.174920:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1787862363.189063:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862363.189874:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223364992 00000100:00100000:1.0:1787862363.189890:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223364992 00000100:00100000:1.0:1787862363.189972:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:1.0:1787862363.189984:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223364992:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:1.0:1787862363.190346:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.190368:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.190397:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862363.190745:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787862363.190877:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223364992:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 891us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862363.190889:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:1.0:1787862363.195236:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.195327:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223365120 00000100:00100000:0.0:1787862363.195340:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223365120 00000100:00100000:0.0:1787862363.195415:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 111 00000100:00100000:0.0:1787862363.195427:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:10643:x1874709223365120:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862363.195457:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862363.195489:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c072a expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.195597:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.195610:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 55 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.195635:0:5870:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.195653:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 55 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.195670:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862363.195673:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862363.195677:0:5870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 55 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.195685:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160200, rc 0) 00000100:00100000:0.0:1787862363.195769:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10643:x1874709223365120:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 343us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.195778:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 111 00000040:00080000:0.0:1787862363.205017:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862363.205032:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862363.205186:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787862363.205197:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862363.205397:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246452608:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862363.205507:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862363.219779:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.219958:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223365248 00000100:00100000:3.0:1787862363.219971:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223365248 00000100:00100000:3.0:1787862363.220083:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:3.0:1787862363.220096:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223365248:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787862363.220144:0:5868:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787862363.220293:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223365248:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 199us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.220303:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:0.0:1787862363.220797:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246452608:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862363.226369:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.226470:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223365376 00000100:00100000:3.0:1787862363.226483:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223365376 00000100:00100000:3.0:1787862363.226572:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:3.0:1787862363.226584:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10644:x1874709223365376:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.226690:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226714:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226730:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226749:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226757:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226763:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226790:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226799:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226806:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862363.226860:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787862363.226883:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862363.226903:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226916:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226922:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226930:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226936:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862363.226941:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226949:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226972:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:3.0:1787862363.226975:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862363.226982:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.226989:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda34d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227007:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227012:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227028:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227033:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862363.227035:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227106:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227115:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff89a108824400) 00010000:00010000:3.0:1787862363.227117:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862363.227120:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227127:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda354 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227144:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227151:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227157:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227160:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862363.227162:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227178:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227186:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862363.227188:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862363.227191:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.227196:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda35b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.227299:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10644:x1874709223365376:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 715us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.227308:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000001:00080000:0.0:1787862363.228692:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787862363.228710:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787862363.231518:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862363.231640:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223365632 00000100:00100000:1.0:1787862363.231655:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223365632 00000100:00100000:1.0:1787862363.231739:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:1.0:1787862363.231752:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:10644:x1874709223365632:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862363.231783:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862363.231815:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda362 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0731 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.231962:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.231994:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232008:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862363.232022:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787862363.232224:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232233:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232239:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232246:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862363.232251:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232260:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232276:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862363.232279:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862363.232285:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232292:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232358:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda362 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0731 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232371:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:1.0:1787862363.232373:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862363.232378:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda362 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0731 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.232401:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8400, rc 0) 00000100:00100000:1.0:1787862363.232493:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a12077bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223365632:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 743us (989us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787862363.232502:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1787862363.242223:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.242451:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223365760 00000100:00100000:0.0:1787862363.242464:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223365760 00000100:00100000:0.0:1787862363.242540:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:0.0:1787862363.242552:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223365760:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787862363.242600:0:9468:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787862363.242731:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223365760:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 180us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.242739:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:2.0:1787862363.247420:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862363.247546:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223366016 00000100:00100000:1.0:1787862363.247560:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223366016 00000100:00100000:1.0:1787862363.247643:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:1.0:1787862363.247655:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223366016:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862363.247684:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862363.247687:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787862363.247738:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0715 expref: 56 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.247763:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862363.247769:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862363.247787:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda377 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0738 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862363.248441:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787862363.248728:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda37e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.248745:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.248757:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.248853:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda377 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0738 expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.248871:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda37e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0738 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.248881:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:1.0:1787862363.248884:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862363.248886:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8a00, rc 0) 00000100:00100000:1.0:1787862363.248975:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:10644:x1874709223366016:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1322us (1570us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787862363.248985:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:0.0:1787862363.253278:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.253494:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223366272 00000100:00100000:3.0:1787862363.253508:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223366272 00000100:00100000:3.0:1787862363.253584:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:3.0:1787862363.253596:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:10644:x1874709223366272:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.253682:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.253720:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda37e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0738 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.253742:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a104fc5500) 00010000:00010000:3.0:1787862363.253754:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862363.253784:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.253819:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.253832:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.254003:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.254027:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.254094:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255512:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255530:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255539:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255546:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862363.255551:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255558:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255576:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862363.255580:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862363.255601:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255607:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda38c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255626:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255632:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255638:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255643:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862363.255646:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255651:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255659:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x70a355d3 (ffff89a108824400) 00010000:00010000:2.0:1787862363.255661:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862363.255798:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.255807:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda393 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x70a355d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.255961:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223366272:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 2359us (2710us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862363.256184:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:1.0:1787862363.264993:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.265257:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223366400 00000100:00100000:3.0:1787862363.265269:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223366400 00000100:00100000:3.0:1787862363.265341:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:3.0:1787862363.265357:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:10644:x1874709223366400:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.265389:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862363.265431:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda39a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c073f expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.265479:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.265496:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.265510:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.265659:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda39a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.265682:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.265692:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862363.265696:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862363.265815:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862363.265982:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:10644:x1874709223366400:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 624us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.265990:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00010000:00010000:3.0:1787862363.269161:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862363.279457:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.280247:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223366656 00000100:00100000:3.0:1787862363.280265:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223366656 00000100:00100000:3.0:1787862363.280356:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:3.0:1787862363.280370:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:10644:x1874709223366656:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.280497:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.280521:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.280539:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862363.282895:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787862363.282937:0:5870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414317896126ns, next at 415317893454ns, rc = 0 00000004:00010000:3.0:1787862363.283201:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003a05f6e6 reply state 000000001f16e6d6 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.283216:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862363.283404:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:10644:x1874709223366656:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 3031us (3958us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787862363.283426:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:0.0:1787862363.286076:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1787862363.286536:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.286552:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.286560:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.286568:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862363.286573:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.286583:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.286633:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:1.0:1787862363.286637:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862363.286643:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.286650:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda3a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.286690:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223366784 00000100:00100000:3.0:1787862363.286703:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223366784 00000100:00100000:3.0:1787862363.286780:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:3.0:1787862363.286792:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:10644:x1874709223366784:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.286824:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862363.286844:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0746 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.286908:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.286920:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.286937:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862363.286938:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862363.286940:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:3.0:1787862363.287025:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:10644:x1874709223366784:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 235us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.287033:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:0.0:1787862363.291193:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.291376:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223366912 00000100:00100000:3.0:1787862363.291391:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223366912 00000100:00100000:3.0:1787862363.291481:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:3.0:1787862363.291495:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223366912:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787862363.291999:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223366912:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 504us (819us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787862363.292008:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00080000:0.0:1787862363.292268:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862363.298953:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862363.299186:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223367168 00000100:00100000:2.0:1787862363.299199:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223367168 00000100:00100000:2.0:1787862363.299336:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1787862363.299349:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:10644:x1874709223367168:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862363.299720:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:10644:x1874709223367168:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 371us (780us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787862363.299730:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1787862363.302262:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.302417:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223367424 00000100:00100000:0.0:1787862363.302429:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223367424 00000100:00100000:0.0:1787862363.302503:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:0.0:1787862363.302516:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:10644:x1874709223367424:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787862363.302668:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:10644:x1874709223367424:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 153us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.302676:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:1.0:1787862363.305385:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.305503:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223367552 00000100:00100000:0.0:1787862363.305517:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223367552 00000100:00100000:0.0:1787862363.305595:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:0.0:1787862363.305622:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:10644:x1874709223367552:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862363.305652:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862363.305911:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda3b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c074d expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.306646:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda3bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.306869:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.306888:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862363.306954:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862363.307092:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.307141:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142161000/0x391a6cd368cda3b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c074d expref: 62 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.307166:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda3bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c074d expref: 61 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.307176:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:1.0:1787862363.307180:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787862363.307201:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9a00, rc 0) 00000100:00100000:1.0:1787862363.307378:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:10644:x1874709223367552:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1757us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862363.307389:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:1.0:1787862363.310650:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.310900:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223367680 00000100:00100000:0.0:1787862363.310914:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223367680 00000100:00100000:0.0:1787862363.311174:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1787862363.311186:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223367680:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862363.311212:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862363.311243:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0754 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862363.311279:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909d5b, blocks: 0x1 00010000:00010000:0.0:1787862363.311308:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787862363.311324:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862363.311337:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 10 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.311357:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 10 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.311374:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160400, rc 0) 00000100:00100000:0.0:1787862363.311460:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2352:x1874709223367680:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 276us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.311468:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1787862363.314480:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.314586:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223367936 00000100:00100000:3.0:1787862363.314601:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223367936 00000100:00100000:3.0:1787862363.314679:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:3.0:1787862363.314691:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b9792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:10644:x1874709223367936:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862363.314855:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b9792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:10644:x1874709223367936:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 166us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.314863:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:2.0:1787862363.318201:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.320453:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368064 00000100:00100000:0.0:1787862363.320477:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368064 00000100:00100000:0.0:1787862363.320832:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:0.0:1787862363.320846:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:10644:x1874709223368064:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862363.320874:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862363.320905:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c075b expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.320947:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 11 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.320958:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862363.320976:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862363.320983:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.321032:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 11 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.321082:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 11 pid: 6712 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.321102:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874709246452736:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862363.321363:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862363.326492:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.326991:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368192 00000100:00100000:3.0:1787862363.327005:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368192 00010000:00010000:3.0:1787862363.327105:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 12 pid: 6712 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.327159:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:3.0:1787862363.327171:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:2353:x1874709223368192:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862363.327197:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.327229:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 12 pid: 6712 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.327244:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 12 pid: 6712 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.327298:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862363.327304:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862363.327353:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.327366:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.327419:0:5855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.327438:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5855:1874709246452864:192.168.202.9@tcp:105: 00000100:00100000:3.0:1787862363.327550:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334da80 going to sleep for 11 seconds 00010000:00010000:0.0:1787862363.328189:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036fc3370/0x391a6cd368cda3c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0754 expref: 12 pid: 6712 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.328231:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874709246452736:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862363.328267:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.328280:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8800, rc 0) 00000100:00100000:0.0:1787862363.328336:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:10644:x1874709223368064:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 7492us (10151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.328345:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1787862363.332269:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a120778000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5855:1874709246452864:192.168.202.9@tcp:105: 00010000:00010000:3.0:1787862363.332310:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862363.332404:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2353:x1874709223368192:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 5234us (5930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.332419:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:3.0:1787862363.333200:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.333269:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368320 00000100:00100000:0.0:1787862363.333282:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368320 00002000:00100000:0.0:1787862363.333356:0:6716:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff89a120778000 x1874709223368320/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:479/0 lens 504/0 e 0 to 0 dl 1787862374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862363.333370:0:6716:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a120778000 with x1874709223368320 ext(0->12) 00002000:00010000:0.0:1787862363.333378:0:6716:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a120778000 00000100:00100000:0.0:1787862363.333425:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:0.0:1787862363.333436:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2353:x1874709223368320:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787862363.334029:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:2353:x1874709223368320:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 585us (825us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787862363.334081:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00002000:00100000:0.0:1787862363.334093:0:6716:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff89a120778000 x1874709223368320/t4294967308(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:479/0 lens 504/448 e 0 to 0 dl 1787862374 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862363.334103:0:6716:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a120778000 with x1874709223368320 ext(0->12) 00002000:00010000:0.0:1787862363.334126:0:6716:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a120778000 00000100:00100000:3.0:1787862363.336934:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862363.337161:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368448 00000100:00100000:1.0:1787862363.337174:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368448 00000100:00100000:1.0:1787862363.337252:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:1.0:1787862363.337265:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:10644:x1874709223368448:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787862363.394645:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000100:00100000:2.0:1787862363.395444:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:10644:x1874709223368448:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 58169us (58513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862363.395462:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00000020:00080000:0.0:1787862363.395549:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1787862363.395573:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:0.0:1787862363.395609:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a120664c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787862363.395615:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a108aca400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a1204553c0 00000020:00080000:0.0:1787862363.395619:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a108acaf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a0063c9c00 00000001:00080000:0.0:1787862363.395637:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787862363.395656:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1787862363.395689:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787862363.396356:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:2.0:1787862363.396631:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:0.0:1787862363.396813:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787862363.396839:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a10334d840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787862363.396844:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a112f14100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a10334d780 00000020:00080000:0.0:1787862363.396847:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a112f14e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a112ad8000 00000100:00100000:3.0:1787862363.397464:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246453120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787862363.397561:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862363.397634:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862363.397639:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246453248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787862363.397679:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862363.397815:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246452992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787862363.397851:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862363.397890:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246453120 00000100:00100000:0.0:1787862363.397900:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246453120 00000100:00100000:0.0:1787862363.397952:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246453248 00000100:00100000:0.0:1787862363.397955:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246453248 00000100:00100000:0.0:1787862363.397966:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246452992 00000100:00100000:0.0:1787862363.397968:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246452992 00000100:00100000:0.0:1787862363.397984:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862363.397993:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246453120:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787862363.398129:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862363.398140:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246453248:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787862363.400509:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787862363.400632:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00080000:0.0:1787862363.400878:0:9223:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787862363.400919:0:9223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.400986:0:9223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.401866:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787862363.401878:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862363.401888:0:9223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.401951:0:9223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.401982:0:9223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 11 pid: 6709 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862363.402346:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787862363.402351:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787862363 00002000:00010000:1.0:1787862363.402354:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862363.402356:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787862363 -> 1787862363 00002000:00010000:1.0:1787862363.402359:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787862363.402451:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3327:x1874709246453248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4310us (4767us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787862363.402464:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862363.402511:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787862363.402529:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246452992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787862363.402561:0:6712:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787862363.402599:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a909d5a, atime: 0x0, ctime: 0x6a909d5a, blocks: 0xb 00010000:00010000:1.0:1787862363.402607:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.402648:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1787862363.402651:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862363.402661:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.402681:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.402692:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.402919:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862363.402974:0:6709:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787862363.402985:0:6709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:3.0:1787862363.403396:0:3327:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13d3f1680/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787862363.403407:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246453248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787862363.403628:0:9223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246453376:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862363.403764:0:9223:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a101463c00 going to sleep for 11 seconds 00010000:00010000:1.0:1787862363.404656:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.404689:0:6712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787862363.405144:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368576 00000100:00100000:2.0:1787862363.405158:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368576 00010000:00010000:3.0:1787862363.405826:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862363.405839:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.405853:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862363.405859:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.405870:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.405898:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.405906:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cda3d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.405933:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862363.405935:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862363.405937:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862363.406553:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:2.0:1787862363.406573:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:2352:x1874709223368576:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787862363.408995:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246452992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6463us (11132us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787862363.409013:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787862363.410029:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787862363.410068:0:3330:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1787862363.410097:0:3330:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13c1a7840, transno 4294967301 00000004:00080000:3.0:1787862363.410109:0:3330:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1787862363.410139:0:3330:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89a13cbead00 x1874709246452992/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787862379 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787862363.410153:0:3330:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13cbead00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787862363.410159:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246452992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787862363.420141:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.420466:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368704 00000100:00100000:0.0:1787862363.420480:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368704 00010000:00010000:0.0:1787862363.420541:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 13 pid: 6709 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.420594:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:0.0:1787862363.420607:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2352:x1874709223368704:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862363.420630:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862363.420657:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 13 pid: 6709 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.420672:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 13 pid: 6709 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.420719:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862363.420725:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862363.420731:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.420744:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.420771:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862363.420852:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2352:x1874709223368704:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 247us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.420861:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00010000:00010000:3.0:1787862363.421427:0:9223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cda194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c06ba expref: 12 pid: 6709 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.421448:0:9223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246453376:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862363.421483:0:9223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.421495:0:9223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.421503:0:9223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.421514:0:9223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.421523:0:9223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.421544:0:9223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862363.424385:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862363.424405:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.424436:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862363.424442:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.424456:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.424495:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.424503:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47c98ed/0x391a6cd368cda3d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.424530:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862363.424532:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862363.424534:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787862363.427659:0:3327:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a00838a1c0/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787862363.427681:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246453120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787862363.427815:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3327:x1874709246453120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28000us (28432us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787862363.427854:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000001:00080000:0.0:1787862363.471250:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1787862363.471280:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787862363.471288:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787862363.471602:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223368576:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 65026us (68674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862363.471617:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1787862363.475628:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.478606:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223368960 00000100:00100000:3.0:1787862363.478632:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223368960 00000100:00100000:3.0:1787862363.478733:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:3.0:1787862363.478745:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10644:x1874709223368960:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.478821:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.478857:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda3bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c074d expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.478885:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862363.478892:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862363.478941:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.478970:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.478984:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862363.479771:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b2272641 reply state 00000000478ecbd8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.479789:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862363.479950:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:10644:x1874709223368960:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1204us (4337us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787862363.480092:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 125 00010000:00010000:3.0:1787862363.482792:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.482838:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.482847:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.482854:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862363.482860:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.482870:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.482892:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862363.482896:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862363.482902:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.482909:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862363.501466:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.501678:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223369088 00000100:00100000:3.0:1787862363.501694:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223369088 00000100:00100000:3.0:1787862363.501784:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:3.0:1787862363.501796:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223369088:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787862363.502223:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787862363.502229:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787862363 -> 1787862363 00002000:00010000:3.0:1787862363.502231:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787862362 00002000:00010000:3.0:1787862363.502234:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787862363 -> 1787862363 00002000:00010000:3.0:1787862363.502261:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787862363.502360:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223369088:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 562us (909us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787862363.502371:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1787862363.506604:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862363.507636:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223369344 00000100:00100000:1.0:1787862363.507655:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223369344 00000100:00100000:1.0:1787862363.507768:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:1.0:1787862363.507782:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:10644:x1874709223369344:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787862363.507911:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.507935:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.507947:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.508008:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.508028:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 15 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862363.508343:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246453504:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862363.508507:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c3f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862363.512513:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.515635:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223369472 00000100:00100000:3.0:1787862363.515660:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223369472 00010000:00010000:3.0:1787862363.515762:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 16 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.515841:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1787862363.515855:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:2352:x1874709223369472:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862363.515877:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.515885:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 16 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.515903:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 16 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.515933:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862363.515940:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.515951:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.515970:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.515998:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862363.516170:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:2352:x1874709223369472:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 318us (3675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.516179:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00010000:00010000:2.0:1787862363.520491:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda3a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c073f expref: 15 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.520528:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246453504:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862363.520564:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521563:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521579:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521625:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521831:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521840:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521875:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862363.521881:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521891:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521915:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:0.0:1787862363.521918:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787862363.521923:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.521930:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda3e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862363.523440:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10644:x1874709223369344:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 15644us (16837us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787862363.523458:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:1.0:1787862363.530684:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.530915:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223369600 00000100:00100000:0.0:1787862363.530931:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223369600 00000100:00100000:0.0:1787862363.531867:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:0.0:1787862363.531887:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2354:x1874709223369600:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787862363.531966:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.531991:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.532002:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862363.532007:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862363.532012:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.532096:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.532112:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 7 pid: 6712 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.532130:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874709246453632:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862363.532541:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1029f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862363.539424:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.539956:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223369728 00000100:00100000:3.0:1787862363.539982:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223369728 00010000:00010000:3.0:1787862363.540070:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 8 pid: 6712 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.540134:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:3.0:1787862363.540147:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223369728:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862363.540168:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.540200:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 8 pid: 6712 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.540228:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 8 pid: 6712 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.540265:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862363.540270:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862363.540278:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.540291:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.540328:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862363.540404:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223369728:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 259us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.540431:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00010000:00010000:2.0:1787862363.540994:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda3cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c075b expref: 7 pid: 6712 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.541018:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874709246453632:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862363.541091:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541106:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541115:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541154:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541179:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541189:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541197:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9c00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862363.541213:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541226:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541249:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.541257:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028fe19f1/0x391a6cd368cda3ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.541339:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223369600:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 9460us (10673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862363.541349:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1787862363.546405:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.546512:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223369984 00000100:00100000:3.0:1787862363.546537:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223369984 00000100:00100000:3.0:1787862363.546626:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 127 00000100:00100000:3.0:1787862363.546649:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10644:x1874709223369984:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787862363.546779:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.546804:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.546821:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.549691:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.549864:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.549876:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.549941:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.551422:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 15 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.551498:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c6a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246453760:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862363.552019:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10334d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787862363.559396:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.559656:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223370112 00000100:00100000:0.0:1787862363.559682:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223370112 00010000:00010000:0.0:1787862363.559751:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 16 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.559804:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:0.0:1787862363.559816:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:2353:x1874709223370112:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862363.559841:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862363.559850:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 16 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.559868:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 16 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.559901:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:0.0:1787862363.559907:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.559945:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.559953:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.559980:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862363.560097:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+16:2353:x1874709223370112:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 283us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.560107:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00010000:00010000:2.0:1787862363.561682:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda3af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0746 expref: 15 pid: 5868 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.561744:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c6a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246453760:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862363.561780:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.561793:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.561800:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862363.562132:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787862363.562552:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787862363.562614:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787862363.563564:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5870:1874709246453888:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787862363.563693:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862363.564599:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a101254c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862363.565426:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246453888 00000100:00100000:0.0:1787862363.565441:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246453888 00000100:00100000:0.0:1787862363.565527:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862363.565540:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5870:x1874709246453888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787862363.565714:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5870:x1874709246453888:12345-0@lo:1000:mdt00_002.0 Request processed in 176us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.565724:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862363.565891:0:5870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787862363.565900:0:5870:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787862363.565944:0:5870:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13d3f1680, transno 4294967309 00000100:00100000:1.0:1787862363.565981:0:5870:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89a00838a1c0 x1874709246453120/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787862379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862363.565998:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5870:1874709246453888:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787862363.566719:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787862363.567346:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5870:1874709246454016:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787862363.567444:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862363.567489:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c3f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862363.568137:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246454016 00000100:00100000:2.0:1787862363.568149:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246454016 00000100:00100000:2.0:1787862363.568228:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862363.568240:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5870:x1874709246454016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787862363.568544:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5870:x1874709246454016:12345-0@lo:1000:mdt00_002.0 Request processed in 305us (1098us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787862363.568554:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862363.569166:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5870:1874709246454016:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787862363.569375:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569389:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569398:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569405:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862363.569411:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569419:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569443:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a108824f00) 00010000:00010000:1.0:1787862363.569446:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862363.569452:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569480:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda3fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569523:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569529:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569535:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569539:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862363.569542:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569547:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569556:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862363.569557:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862363.569566:0:5870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569580:0:5870:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569590:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862363.569647:0:5870:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862363.569679:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246454144:192.168.202.9@tcp:105: 00000100:00100000:1.0:1787862363.569813:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c3f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787862363.574731:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.574851:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223370240 00000100:00100000:0.0:1787862363.574864:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223370240 00000100:00100000:0.0:1787862363.574970:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:0.0:1787862363.574983:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10643:x1874709223370240:12345-192.168.202.9@tcp:49:lfs.0 00000100:00100000:0.0:1787862363.575381:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10643:x1874709223370240:12345-192.168.202.9@tcp:49:lfs.0 Request processed in 398us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862363.575391:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:2.0:1787862363.576284:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246454144:192.168.202.9@tcp:105: 00010000:00010000:2.0:1787862363.576342:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576512:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda33f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576558:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576577:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576593:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576605:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576612:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576620:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576627:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862363.576632:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576640:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576653:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:2.0:1787862363.576657:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862363.576661:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576675:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda403 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576687:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576693:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576771:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576776:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862363.576780:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576786:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576796:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:2.0:1787862363.576798:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787862363.576802:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.576808:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda3f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862363.580064:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:10644:x1874709223369984:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 33382us (33626us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787862363.580110:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 127 00000020:00080000:0.0:1787862363.580121:0:5870:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787862363.580918:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862363.580927:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862363.584838:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787862363.584864:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862363.585648:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862363.586071:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223370496 00000100:00100000:2.0:1787862363.586086:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223370496 00000100:00100000:2.0:1787862363.586165:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:2.0:1787862363.586177:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:10643:x1874709223370496:12345-192.168.202.9@tcp:58:lfs.0 00000100:00100000:3.0:1787862363.590435:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.590855:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223370752 00000100:00100000:0.0:1787862363.590873:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223370752 00000100:00100000:0.0:1787862363.590972:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:0.0:1787862363.590984:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:10644:x1874709223370752:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1787862363.592658:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000004:00080000:0.0:1787862363.593831:0:5871:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787862363.593978:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787862363.594098:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.594122:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.594138:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.594150:0:5871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.594158:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.594165:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862363.594212:0:5871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787862363.594359:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10643:x1874709223370496:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 8175us (8713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862363.594371:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 128 00010000:00010000:3.0:1787862363.594587:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862363.594597:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.594605:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862363.594609:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.594619:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.594635:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89a116882700) 00010000:00010000:3.0:1787862363.594638:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862363.594644:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.594650:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda40a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.594670:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862363.594672:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862363.594673:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862363.595222:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:10644:x1874709223370752:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 4233us (4799us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787862363.595234:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000020:00080000:0.0:1787862363.595257:0:5871:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787862363.636371:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.637155:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223370880 00000100:00100000:3.0:1787862363.637173:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223370880 00000100:00100000:3.0:1787862363.637295:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:3.0:1787862363.637319:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:10646:x1874709223370880:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862363.637387:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862363.637420:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda411 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0762 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.637523:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.637544:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.637559:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.637578:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.637586:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.637594:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.640455:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.640490:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 21 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.640501:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.640564:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 21 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.640584:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 21 pid: 9468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862363.640605:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246454272:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862363.641503:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862363.645550:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862363.646550:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223371136 00000100:00100000:0.0:1787862363.646568:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223371136 00000100:00100000:0.0:1787862363.646666:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:0.0:1787862363.646678:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:5595:x1874709223371136:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787862363.647105:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:5595:x1874709223371136:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 426us (1570us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787862363.647114:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1787862363.649991:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246454272:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862363.650034:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862363.651570:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862363.652377:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223371264 00000100:00100000:3.0:1787862363.652393:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223371264 00010000:00010000:3.0:1787862363.652456:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 23 pid: 9468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862363.652630:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:3.0:1787862363.652651:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:2353:x1874709223371264:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862363.652679:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862363.652712:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 23 pid: 9468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.652728:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 23 pid: 9468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.652758:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda331 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0723 expref: 23 pid: 9468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.652782:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862363.652789:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.652801:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.652809:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862363.652843:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862363.652937:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:2353:x1874709223371264:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 288us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862363.652946:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00010000:00010000:2.0:1787862363.653296:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653317:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862363.653391:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787862363.653398:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862363.653428:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653446:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653457:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653463:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653470:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653476:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862363.653481:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653489:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653502:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:2.0:1787862363.653519:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862363.653524:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653530:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda418 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653548:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653553:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653558:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653562:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862363.653565:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653570:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653577:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89a108824600) 00010000:00010000:2.0:1787862363.653580:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862363.653582:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653587:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda41f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653636:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda411 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0762 expref: 22 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653664:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0762 expref: 21 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862363.653671:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:2.0:1787862363.653674:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862363.653676:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f000, rc 0) 00000100:00100000:2.0:1787862363.653744:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10646:x1874709223370880:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 16437us (17391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862363.653753:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 129 00010000:00010000:3.0:1787862364.294839:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862364.615278:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862364.615289:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862364.615357:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787862364.615364:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862364.615508:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246454400:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787862364.615615:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862364.624519:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246454400:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862364.652881:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862364.652982:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223371392 00000100:00100000:2.0:1787862364.652993:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223371392 00000100:00100000:2.0:1787862364.653087:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:2.0:1787862364.653099:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10657:x1874709223371392:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862364.653138:0:5869:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862364.653251:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10657:x1874709223371392:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 154us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862364.653273:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00080000:0.0:1787862364.656240:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862364.658848:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862364.660559:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223371648 00000100:00100000:0.0:1787862364.660577:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223371648 00000100:00100000:0.0:1787862364.660660:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 131 00000100:00100000:0.0:1787862364.660672:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:10657:x1874709223371648:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862364.660694:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862364.660718:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda42d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0769 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862364.660823:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862364.660840:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862364.660853:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862364.660865:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787862364.661026:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda42d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0769 expref: 24 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862364.661084:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0769 expref: 23 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862364.661095:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862364.661098:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862364.661102:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8c00, rc 0) 00000100:00100000:0.0:1787862364.661201:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:10657:x1874709223371648:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 531us (2380us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787862364.661208:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 131 00000100:00100000:3.0:1787862364.665798:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862364.666946:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223371904 00000100:00100000:1.0:1787862364.666962:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223371904 00000100:00100000:1.0:1787862364.667052:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:1.0:1787862364.667065:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:10657:x1874709223371904:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862364.667148:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667181:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667194:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667488:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667496:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667516:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667521:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862364.667525:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667533:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667545:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862364.667548:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787862364.667552:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862364.667559:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda442 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862364.667742:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:10657:x1874709223371904:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 678us (1957us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787862364.667752:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 132 00000040:00080000:0.0:1787862364.667966:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862364.667971:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862364.668552:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787862364.668561:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862364.673922:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862364.677352:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223372160 00000100:00100000:0.0:1787862364.677366:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223372160 00000100:00100000:0.0:1787862364.677425:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1787862364.677436:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:10657:x1874709223372160:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787862364.677664:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:10657:x1874709223372160:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 230us (3760us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787862364.677672:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1787862364.677796:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862364.677865:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223372288 00000100:00100000:0.0:1787862364.677870:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223372288 00000100:00100000:0.0:1787862364.677908:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1787862364.677917:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:2355:x1874709223372288:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862364.677937:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862364.677961:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0769 expref: 25 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862364.677980:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:0.0:1787862364.677985:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862364.678017:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:2355:x1874709223372288:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862364.678024:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000040:00080000:1.0:1787862364.939364:0:12122:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862364.939380:0:12122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862364.939438:0:12122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787862364.939448:0:12122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862365.193252:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862365.193290:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246454528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862365.193416:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862365.194575:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246454528 00000100:00100000:2.0:1787862365.194593:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246454528 00000100:00100000:2.0:1787862365.194713:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787862365.194726:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246454528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862365.194784:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862365.194901:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246454528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862365.194911:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787862365.195084:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862365.195168:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246454528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862365.195169:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862365.195980:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223372544 00000100:00100000:2.0:1787862365.195990:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223372544 00000100:00100000:2.0:1787862365.196091:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00100000:2.0:1787862365.196104:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:10670:x1874709223372544:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862365.196205:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862365.196241:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0770 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862365.196400:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda450 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862365.196420:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862365.196437:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862365.196451:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787862365.196636:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0770 expref: 27 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862365.196659:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0770 expref: 26 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862365.196689:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:2.0:1787862365.196693:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787862365.196698:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79ee00, rc 0) 00000100:00100000:2.0:1787862365.196776:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10670:x1874709223372544:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 676us (1611us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787862365.196784:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00100000:0.0:1787862365.211912:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862365.229415:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223372672 00000100:00100000:3.0:1787862365.229457:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223372672 00000100:00100000:3.0:1787862365.229557:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:3.0:1787862365.229570:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10670:x1874709223372672:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1787862365.229676:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229699:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229714:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229750:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229757:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229764:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229771:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862365.229777:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229785:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229799:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:3.0:1787862365.229802:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862365.229809:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.229826:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d000/0x391a6cd368cda45e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862365.230086:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:10670:x1874709223372672:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 517us (18188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862365.230095:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 134 00010000:00010000:3.0:1787862365.338157:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862365.338700:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862365.338923:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223372800 00000100:00100000:3.0:1787862365.338936:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223372800 00000100:00100000:3.0:1787862365.339073:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1787862365.339086:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223372800:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:3.0:1787862365.339113:0:12084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787862365.339227:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787862365.339389:0:12084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cda465 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0777 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862365.339429:0:12084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a909d5b, atime: 0x6a909d5a, ctime: 0x6a909d5b, blocks: 0xb 00010000:00010000:3.0:1787862365.339459:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1787862365.339465:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862365.339477:0:12084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cda465 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0777 expref: 7 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.339502:0:12084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cda465 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0777 expref: 7 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862365.339519:0:12084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d000, rc 0) 00000100:00100000:3.0:1787862365.339609:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2355:x1874709223372800:12345-192.168.202.9@tcp:101:cat.0 Request processed in 525us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862365.340317:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:1.0:1787862365.353754:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862365.357619:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223372928 00000100:00100000:3.0:1787862365.357642:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223372928 00002000:00100000:3.0:1787862365.357728:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff89a13d0b83c0 x1874709223372928/t0(0) o3->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:481/0 lens 488/0 e 0 to 0 dl 1787862376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862365.357742:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d0b83c0 with x1874709223372928 ext(0->4095) 00002000:00010000:3.0:1787862365.357750:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13d0b83c0 00000100:00100000:3.0:1787862365.357794:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1787862365.357806:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2354:x1874709223372928:12345-192.168.202.9@tcp:3:cat.0 00000100:00100000:3.0:1787862365.358180:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2354:x1874709223372928:12345-192.168.202.9@tcp:3:cat.0 Request processed in 373us (4437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787862365.358189:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00002000:00100000:3.0:1787862365.358197:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff89a13d0b83c0 x1874709223372928/t0(0) o3->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:481/0 lens 488/4536 e 0 to 0 dl 1787862376 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862365.358206:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d0b83c0 with x1874709223372928 ext(0->4095) 00002000:00010000:3.0:1787862365.358209:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13d0b83c0 00010000:00010000:3.0:1787862366.341185:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862366.547920:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862366.547975:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862366.548072:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862366.548102:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862366.548131:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862366.548171:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373312 00000100:00100000:3.0:1787862366.548182:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373312 00000100:00100000:3.0:1787862366.548262:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373440 00000100:00100000:3.0:1787862366.548274:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373440 00000100:00100000:3.0:1787862366.548318:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:3.0:1787862366.548330:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223373312:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862366.548429:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223373312:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 101us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862366.548438:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:3.0:1787862366.548460:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:3.0:1787862366.548466:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d8592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2355:x1874709223373440:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862366.548492:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d8592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2355:x1874709223373440:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862366.548498:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:3.0:1787862366.548517:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373568 00000100:00100000:3.0:1787862366.548521:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373568 00000100:00100000:3.0:1787862366.548554:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373184 00000100:00100000:3.0:1787862366.548556:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373184 00000100:00100000:3.0:1787862366.548579:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:3.0:1787862366.548585:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d859e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223373568:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862366.548616:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d859e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223373568:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862366.548623:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:3.0:1787862366.548634:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:3.0:1787862366.548639:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:2355:x1874709223373184:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862366.548662:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:2355:x1874709223373184:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 23us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862366.548668:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00080000:3.0:1787862366.548706:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862366.548711:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862366.549118:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373056 00000100:00100000:1.0:1787862366.549125:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373056 00000100:00100000:1.0:1787862366.549166:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 298 00000100:00100000:1.0:1787862366.549183:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223373056:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862366.549225:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223373056:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 44us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862366.549232:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 298 00000100:00100000:1.0:1787862367.238847:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246454784:0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.238955:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862367.239024:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246455296:0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.239084:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862367.239123:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862367.239130:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246454912:0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.239156:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862367.239198:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246454784 00000100:00100000:1.0:1787862367.239206:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246454784 00000100:00100000:1.0:1787862367.239263:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246454912 00000100:00100000:1.0:1787862367.239266:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246454912 00000100:00100000:1.0:1787862367.239314:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787862367.239448:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246454656:0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.239495:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862367.239524:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246455168:0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.239549:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862367.239561:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862367.239566:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246455040:0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.239584:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862367.239612:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455296 00000100:00100000:3.0:1787862367.239615:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455296 00000100:00100000:3.0:1787862367.239645:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455040 00000100:00100000:3.0:1787862367.239647:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455040 00000100:00100000:3.0:1787862367.239666:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787862367.239672:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246455296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.239730:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246455296:12345-0@lo:400:kworker.0 Request processed in 58us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862367.239738:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787862367.239758:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787862367.239764:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246455040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.239791:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246455040:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862367.239798:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787862367.239841:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246455040:0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.241447:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246454784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.241582:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246454784:12345-0@lo:400:kworker.0 Request processed in 2255us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862367.241594:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787862367.241632:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455168 00000100:00100000:1.0:1787862367.241641:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455168 00000100:00100000:1.0:1787862367.241685:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787862367.241693:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246454912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.241725:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246454912:12345-0@lo:400:kworker.0 Request processed in 33us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862367.241752:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787862367.241769:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787862367.241775:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d859a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.241814:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d859a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246455168:12345-0@lo:400:kworker.0 Request processed in 39us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862367.241820:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1787862367.241876:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862367.241884:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862367.241889:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862367.241911:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246454656 00000100:00100000:1.0:1787862367.241916:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246454656 00000100:00100000:1.0:1787862367.241956:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787862367.241963:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246454656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.241997:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246454656:12345-0@lo:400:kworker.0 Request processed in 35us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862367.242003:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787862367.242094:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246454912:0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.242111:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246454784:0@lo:400:kworker.0 00000100:00100000:1.0:1787862367.242126:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246455296:0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.244595:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246454656:0@lo:400:kworker.0 00000100:00100000:3.0:1787862367.244625:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246455168:0@lo:400:kworker.0 00010000:00010000:3.0:1787862367.365400:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862367.749544:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246455424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862367.749656:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862367.753709:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455424 00000100:00100000:3.0:1787862367.753731:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455424 00000100:00100000:3.0:1787862367.753859:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787862367.753875:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246455424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862367.753942:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862367.754099:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246455424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862367.754107:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862367.759196:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246455424:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787862368.376019:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:3.0:1787862368.389075:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787862368.889843:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1787862368.889895:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a13c3f6240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787862368.889900:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a108aca100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a13c3f6a80 00000020:00080000:0.0:1787862368.889904:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a108aca700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a13cb55800 00000001:00080000:0.0:1787862368.890190:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787862368.890207:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787862368.890211:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:2.0:1787862368.890564:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787862368.890864:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787862368.905136:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1787862368.905195:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1787862369.413309:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862370.313169:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246455552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862370.313309:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862370.315122:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455552 00000100:00100000:0.0:1787862370.315145:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455552 00000100:00100000:0.0:1787862370.315261:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862370.315275:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246455552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862370.315347:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862370.323089:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246455552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7796us (9759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862370.323121:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787862370.323206:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862370.330761:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787862370.330783:0:3329:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13cbead00, transno 4294967304 00000100:00100000:1.0:1787862370.330845:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246455552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862370.437208:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862370.820886:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862370.820912:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862370.821030:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787862370.821073:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787862371.460489:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862371.670359:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.670402:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.670425:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.670449:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.670476:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.670518:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373696 00000100:00100000:3.0:1787862371.670531:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373696 00000100:00100000:3.0:1787862371.670593:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 300 00000100:00100000:3.0:1787862371.670604:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223373696:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862371.670828:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a103f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223373696:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 224us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.670837:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 300 00000100:00100000:3.0:1787862371.670877:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373952 00000100:00100000:3.0:1787862371.670951:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373952 00000100:00100000:3.0:1787862371.670995:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374080 00000100:00100000:3.0:1787862371.670997:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374080 00000100:00100000:3.0:1787862371.671016:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:3.0:1787862371.671021:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223373952:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862371.671074:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223373952:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 52us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.671081:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:3.0:1787862371.671092:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1787862371.671098:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223374080:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862371.671118:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2354:x1874709223374080:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.671124:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1787862371.671139:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374208 00000100:00100000:3.0:1787862371.671142:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374208 00000100:00100000:3.0:1787862371.671168:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223373824 00000100:00100000:3.0:1787862371.671170:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223373824 00000100:00100000:3.0:1787862371.671187:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:3.0:1787862371.671192:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223374208:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862371.671216:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2354:x1874709223374208:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 25us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.671222:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:3.0:1787862371.671231:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:3.0:1787862371.671249:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2354:x1874709223373824:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862371.671273:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2354:x1874709223373824:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 38us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.671287:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00080000:3.0:1787862371.671456:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862371.671461:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862371.671463:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862371.751668:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.751779:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374336 00000100:00100000:3.0:1787862371.751793:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374336 00000100:00100000:3.0:1787862371.751874:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:3.0:1787862371.751895:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10331:x1874709223374336:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787862371.752105:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10331:x1874709223374336:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 Request processed in 219us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.752113:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:3.0:1787862371.754871:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862371.756533:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374592 00000100:00100000:0.0:1787862371.756552:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374592 00000100:00100000:0.0:1787862371.756655:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:0.0:1787862371.756669:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:10331:x1874709223374592:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787862371.757405:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:10331:x1874709223374592:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 734us (2545us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787862371.757416:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:1.0:1787862371.915930:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862371.916033:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374720 00000100:00100000:3.0:1787862371.916085:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374720 00000100:00100000:3.0:1787862371.916182:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 136 00000100:00100000:3.0:1787862371.916192:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:11122:x1874709223374720:12345-192.168.202.9@tcp:101:lsof.0 00010000:00010000:3.0:1787862371.916217:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862371.916257:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda46c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c077e expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862371.916401:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862371.916420:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862371.916437:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862371.916770:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862371.916774:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862371.916873:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862371.916959:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda46c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862371.916982:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 6 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862371.916992:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:3.0:1787862371.916995:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862371.917001:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2da00, rc 0) 00000100:00100000:3.0:1787862371.917142:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:11122:x1874709223374720:12345-192.168.202.9@tcp:101:lsof.0 Request processed in 950us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862371.917152:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 136 00000100:00100000:3.0:1787862372.356378:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862372.356509:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862372.356540:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246456064:0@lo:400:kworker.0 00000100:00100000:2.0:1787862372.356656:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862372.356778:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246455936:0@lo:400:kworker.0 00000100:00100000:2.0:1787862372.356810:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862372.356833:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862372.356838:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246455808:0@lo:400:kworker.0 00000100:00100000:2.0:1787862372.356911:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862372.357340:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456064 00000100:00100000:0.0:1787862372.357351:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456064 00000100:00100000:2.0:1787862372.357446:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455936 00000100:00100000:2.0:1787862372.357451:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455936 00000100:00100000:0.0:1787862372.358439:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862372.358455:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246456064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862372.358567:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246456064:12345-0@lo:400:kworker.0 Request processed in 115us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862372.358575:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862372.358640:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455808 00000100:00100000:0.0:1787862372.358646:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455808 00000100:00100000:0.0:1787862372.358678:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787862372.358684:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246455808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862372.358726:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246455808:12345-0@lo:400:kworker.0 Request processed in 42us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862372.358747:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787862372.358813:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246455808:0@lo:400:kworker.0 00000100:00100000:0.0:1787862372.358868:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246456064:0@lo:400:kworker.0 00000100:00100000:2.0:1787862372.359247:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787862372.359258:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246455936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862372.359305:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246455936:12345-0@lo:400:kworker.0 Request processed in 50us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862372.359325:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787862372.359358:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246455936:0@lo:400:kworker.0 00000100:00080000:0.0:1787862372.359446:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862372.359455:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862372.359536:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246455680:0@lo:400:kworker.0 00000100:00100000:3.0:1787862372.359590:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862372.359770:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246455680 00000100:00100000:0.0:1787862372.359777:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246455680 00000100:00100000:0.0:1787862372.359816:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787862372.359824:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246455680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862372.360081:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246455680:12345-0@lo:400:kworker.0 Request processed in 256us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862372.360089:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787862372.360346:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246456320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862372.360390:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862372.360473:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246456192:0@lo:400:kworker.0 00000100:00100000:0.0:1787862372.360505:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862372.360581:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456192 00000100:00100000:3.0:1787862372.360587:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456192 00000100:00100000:3.0:1787862372.360646:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787862372.360653:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246456192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862372.361145:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246456192:12345-0@lo:400:kworker.0 Request processed in 491us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862372.361152:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787862372.361285:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246455680:0@lo:400:kworker.0 00000100:00080000:0.0:1787862372.361359:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862372.361384:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246456192:0@lo:400:kworker.0 00000100:00100000:1.0:1787862372.361466:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456320 00000100:00100000:1.0:1787862372.361472:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456320 00000100:00100000:1.0:1787862372.361528:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787862372.361537:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246456320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862372.361595:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246456320:12345-0@lo:400:kworker.0 Request processed in 60us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862372.361601:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787862372.361727:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862372.361781:0:3327:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787862372.361789:0:3327:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a00838a1c0, transno 4294967310 00000004:00080000:2.0:1787862372.361810:0:3327:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787862372.361830:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246456320:0@lo:400:kworker.0 00010000:00010000:0.0:1787862372.485430:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862372.874494:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862372.874528:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1066d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246456448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862372.874640:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862372.874701:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456448 00000100:00100000:2.0:1787862372.874712:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456448 00000100:00100000:2.0:1787862372.874785:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787862372.874798:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246456448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862372.874863:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862372.874942:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246456448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862372.874952:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862372.874991:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1066d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246456448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862373.508380:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787862373.965811:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787862373.965849:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787862373.965912:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787862373.965936:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787862374.534847:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862375.433366:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862375.433397:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246456576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862375.433494:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862375.433699:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456576 00000100:00100000:2.0:1787862375.433710:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456576 00000100:00100000:2.0:1787862375.433799:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787862375.433812:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246456576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862375.433872:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862375.433953:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246456576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862375.433981:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787862375.434083:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246456576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862375.435727:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862375.561580:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862375.828065:0:12326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:26:13 (1787862373) 00010000:00010000:2.0:1787862376.582706:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862376.788398:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862376.788449:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862376.788561:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862376.788603:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862376.788640:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862376.788720:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223375360 00000100:00100000:2.0:1787862376.788733:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223375360 00000100:00100000:2.0:1787862376.788809:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374976 00000100:00100000:2.0:1787862376.788813:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374976 00000100:00100000:2.0:1787862376.788852:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:2.0:1787862376.788865:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2355:x1874709223375360:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862376.788969:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2355:x1874709223375360:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862376.788978:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:2.0:1787862376.788999:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:2.0:1787862376.789006:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2355:x1874709223374976:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862376.789073:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2355:x1874709223374976:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862376.789080:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00080000:2.0:1787862376.789273:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862376.789624:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223374848 00000100:00100000:3.0:1787862376.789631:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223374848 00000100:00100000:3.0:1787862376.789693:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 302 00000100:00100000:3.0:1787862376.789702:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223374848:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862376.789747:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223374848:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 47us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862376.789754:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 302 00000100:00100000:0.0:1787862376.802455:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223375104 00000100:00100000:0.0:1787862376.802481:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223375104 00000100:00080000:1.0:1787862376.804118:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862376.804431:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223375232 00000100:00100000:0.0:1787862376.804445:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223375232 00000100:00100000:0.0:1787862376.804516:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:0.0:1787862376.804528:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223375104:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862376.804706:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:3.0:1787862376.804718:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223375232:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862376.804807:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223375232:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 92us (16165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862376.804817:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00080000:1.0:1787862376.805426:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862376.805847:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223375104:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 1305us (17380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862376.805859:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:2.0:1787862377.477088:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246456704:0@lo:400:kworker.0 00000100:00100000:2.0:1787862377.477214:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862377.477545:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246456832:0@lo:400:kworker.0 00000100:00100000:1.0:1787862377.477594:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862377.477610:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456704 00000100:00100000:3.0:1787862377.477621:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456704 00000100:00100000:2.0:1787862377.477712:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456832 00000100:00100000:2.0:1787862377.477718:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456832 00000100:00100000:2.0:1787862377.477756:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787862377.477767:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246456832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862377.477883:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787862377.477904:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246456704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862377.477955:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246456704:12345-0@lo:400:kworker.0 Request processed in 53us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862377.477963:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787862377.478078:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246456704:0@lo:400:kworker.0 00000100:00100000:2.0:1787862377.482881:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246456832:12345-0@lo:400:kworker.0 Request processed in 5101us (5272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862377.482930:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787862377.483255:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246456960:0@lo:400:kworker.0 00000100:00100000:2.0:1787862377.483344:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862377.483554:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246456832:0@lo:400:kworker.0 00000100:00100000:1.0:1787862377.483744:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246457088:0@lo:400:kworker.0 00000100:00100000:1.0:1787862377.483785:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862377.484451:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246456960 00000100:00100000:3.0:1787862377.484461:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246456960 00000100:00100000:3.0:1787862377.484597:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787862377.484610:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246456960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862377.484688:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246456960:12345-0@lo:400:kworker.0 Request processed in 80us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862377.484697:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787862377.484744:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246456960:0@lo:400:kworker.0 00000100:00080000:2.0:1787862377.484864:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862377.490463:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246457088 00000100:00100000:3.0:1787862377.490638:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246457088 00000100:00100000:3.0:1787862377.491116:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787862377.491130:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246457088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787862377.491267:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862377.492729:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246457216:0@lo:400:kworker.0 00000100:00100000:2.0:1787862377.492814:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862377.492918:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246457216 00000100:00100000:2.0:1787862377.492928:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246457216 00000100:00100000:2.0:1787862377.492994:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862377.493005:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246457216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862377.493099:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246457216:12345-0@lo:400:kworker.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862377.493108:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1787862377.493136:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862377.493176:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246457216:0@lo:400:kworker.0 00000100:00100000:3.0:1787862377.503009:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246457088:12345-0@lo:400:kworker.0 Request processed in 11862us (19202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862377.503030:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787862377.503397:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862377.503481:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223375616 00000100:00100000:3.0:1787862377.503493:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223375616 00000100:00100000:3.0:1787862377.503559:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 137 00000100:00100000:3.0:1787862377.503580:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:11388:x1874709223375616:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862377.503609:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862377.503638:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda47a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0785 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.503741:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.503783:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.503801:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.503823:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.503830:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.503837:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.504776:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda48f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.504792:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda48f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.504802:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda48f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862377.504815:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00100000:1.0:1787862377.507398:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246457088:0@lo:400:kworker.0 00000100:00100000:0.0:1787862377.507645:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862377.507661:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246457344:0@lo:400:kworker.0 00000100:00100000:0.0:1787862377.507762:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862377.508601:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246457344 00000100:00100000:1.0:1787862377.508611:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246457344 00000100:00100000:1.0:1787862377.508806:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787862377.508970:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246457344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862377.509093:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246457344:12345-0@lo:400:kworker.0 Request processed in 276us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862377.509367:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1787862377.509518:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862377.509559:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246457344:0@lo:400:kworker.0 00010000:00010000:3.0:1787862377.510851:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.510872:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.510880:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511079:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862377.511086:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511095:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511119:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89a116882c00) 00010000:00010000:3.0:1787862377.511123:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862377.511129:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511134:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda481 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511148:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511152:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511251:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511256:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862377.511259:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511266:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511286:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89a108824600) 00010000:00010000:3.0:1787862377.511289:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862377.511291:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862377.511297:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda488 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862377.514827:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda47a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0785 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862377.514866:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda48f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0785 expref: 15 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862377.514877:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:2.0:1787862377.514881:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862377.514886:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d600, rc 0) 00000100:00100000:2.0:1787862377.515439:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:11388:x1874709223375616:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 11865us (12041us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787862377.515450:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 137 00000100:00100000:3.0:1787862377.526696:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862377.526825:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862377.528689:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223375872 00000100:00100000:0.0:1787862377.528710:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223375872 00000100:00100000:0.0:1787862377.528816:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1787862377.528828:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:2355:x1874709223375872:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862377.528849:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862377.528895:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda48f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0785 expref: 15 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862377.528923:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:0.0:1787862377.528929:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862377.529014:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:2355:x1874709223375872:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 188us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862377.529097:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1787862377.532740:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223375744 00000100:00100000:2.0:1787862377.532761:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223375744 00000100:00100000:2.0:1787862377.532865:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 138 00000100:00100000:2.0:1787862377.532879:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:11388:x1874709223375744:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787862377.533368:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:11388:x1874709223375744:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 488us (6685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862377.533377:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 138 00010000:00010000:1.0:1787862377.604241:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862377.988796:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862377.988821:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246457472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862377.988898:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862377.988979:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246457472 00000100:00100000:1.0:1787862377.988986:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246457472 00000100:00100000:1.0:1787862377.989035:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787862377.989058:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246457472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862377.989097:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862377.989144:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246457472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862377.989151:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787862377.989209:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246457472:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787862377.991666:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862377.991676:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862377.993910:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787862377.994425:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787862378.633640:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787862379.101544:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787862379.653608:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862380.038462:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862380.038476:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862380.039227:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787862380.039241:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862380.431958:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862380.432102:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223376000 00000100:00100000:3.0:1787862380.432117:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223376000 00000100:00100000:3.0:1787862380.432225:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 139 00000100:00100000:3.0:1787862380.432237:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:11430:x1874709223376000:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862380.432267:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862380.432296:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda49d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c078c expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432378:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432396:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432410:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432426:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432454:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432461:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787862380.432749:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787862380.432782:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432791:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432799:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432806:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862380.432811:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432820:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432834:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:3.0:1787862380.432837:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862380.432843:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432850:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432864:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432877:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432882:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432887:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862380.432891:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432897:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432905:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89a108824f00) 00010000:00010000:3.0:1787862380.432907:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862380.432910:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432917:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432953:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda49d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c078c expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432964:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:3.0:1787862380.432966:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862380.432970:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda49d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c078c expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.432981:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2dc00, rc 0) 00000100:00100000:3.0:1787862380.433093:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:11430:x1874709223376000:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 858us (1157us total) trans 0 rc 301/301 00000100:00100000:3.0:1787862380.433102:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 139 00000100:00100000:1.0:1787862380.450478:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862380.450568:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223376256 00000100:00100000:0.0:1787862380.450583:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223376256 00000100:00100000:0.0:1787862380.450677:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 140 00000100:00100000:0.0:1787862380.450692:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:11430:x1874709223376256:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:0.0:1787862380.450786:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862380.450829:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cd9e1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05c5 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.450853:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:0.0:1787862380.450860:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862380.451321:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.451341:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 5 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.451353:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.451398:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 5 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.451426:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 5 pid: 5868 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862380.451449:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246457600:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862380.451579:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862380.462508:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246457600:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862380.462558:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862380.462566:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862380.462610:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223376384 00000100:00100000:1.0:1787862380.462623:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223376384 00010000:00010000:1.0:1787862380.462941:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 6 pid: 5868 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862380.462983:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:1.0:1787862380.463008:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2353:x1874709223376384:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862380.463028:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862380.463037:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 6 pid: 5868 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862380.463075:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 6 pid: 5868 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862380.463104:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda473 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c077e expref: 6 pid: 5868 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862380.463126:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00000100:00080000:3.0:1787862380.463129:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862380.463131:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862380.463142:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862380.463160:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862380.463205:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862380.463276:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223376384:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 282us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862380.463286:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00010000:00010000:3.0:1787862380.463467:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.463475:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.463506:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.463518:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.463526:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862380.465150:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787862380.465184:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.465194:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.465204:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.465224:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862380.465231:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.465240:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.465262:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a104fc5000) 00010000:00010000:3.0:1787862380.465266:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862380.465271:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.465277:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda4b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862380.465306:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b85c4245 reply state 00000000b3ceecc4 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862380.465318:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862380.465472:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:11430:x1874709223376256:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 14777us (15010us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787862380.465483:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 140 00010000:00010000:3.0:1787862380.477364:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.477387:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.477397:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.477427:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862380.477433:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.477443:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.477465:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89a108824f00) 00010000:00010000:3.0:1787862380.477468:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862380.477474:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.477481:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862380.549310:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1066d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246457728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862380.549413:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862380.549517:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246457728 00000100:00100000:2.0:1787862380.549527:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246457728 00000100:00100000:2.0:1787862380.549614:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787862380.549626:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246457728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862380.549678:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862380.549741:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246457728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862380.549749:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787862380.549836:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1066d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246457728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862380.550001:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862380.603000:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862380.603183:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223376512 00000100:00100000:3.0:1787862380.603198:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223376512 00000100:00100000:3.0:1787862380.603269:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 141 00000100:00100000:3.0:1787862380.603279:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:11438:x1874709223376512:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:3.0:1787862380.603312:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862380.603338:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0793 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.603416:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.603429:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.603451:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862380.603524:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862380.603527:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862380.603620:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.603647:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0793 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.603662:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0793 expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.603670:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862380.603674:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862380.603679:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c800, rc 0) 00000100:00100000:3.0:1787862380.603756:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:11438:x1874709223376512:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 479us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862380.603762:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 141 00010000:00010000:3.0:1787862380.680339:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862380.694541:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862380.694786:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223376640 00000100:00100000:2.0:1787862380.694799:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223376640 00000100:00100000:2.0:1787862380.694931:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 142 00000100:00100000:2.0:1787862380.694945:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+14:11444:x1874709223376640:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862380.694974:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862380.695008:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda4ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c079a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695181:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695201:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695218:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695236:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695243:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695250:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695414:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cda4e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695424:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cda4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695432:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cda4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862380.695475:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787862380.695481:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862380.695510:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cda4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695538:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695546:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695553:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695560:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862380.695565:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695574:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695592:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:2.0:1787862380.695595:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862380.695602:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695611:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cda4d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695627:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695634:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695640:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695652:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862380.695655:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695661:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695670:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89a1205e1700) 00010000:00010000:2.0:1787862380.695672:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862380.695675:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695682:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda4dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695725:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda4ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c079a expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695742:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cda4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c079a expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.695751:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:2.0:1787862380.695753:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862380.695755:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e400, rc 0) 00000100:00100000:2.0:1787862380.695856:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:11444:x1874709223376640:12345-192.168.202.9@tcp:101:bash.0 Request processed in 914us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862380.695865:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 142 00000100:00100000:2.0:1787862380.712112:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862380.712535:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223376896 00000100:00100000:3.0:1787862380.712550:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223376896 00000100:00100000:3.0:1787862380.712632:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 143 00000100:00100000:3.0:1787862380.712645:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+15:11444:x1874709223376896:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1787862380.712677:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862380.712712:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07a1 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.712943:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.712963:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.712979:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.723228:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.723265:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.723283:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862380.726866:0:5869:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787862380.729945:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.729979:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.729995:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732225:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732249:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732257:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732263:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862380.732269:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732279:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732324:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:0.0:1787862380.732327:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862380.732333:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732340:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda4f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862380.732362:0:5869:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006fa25c7f reply state 00000000d9ed10cf transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862380.732372:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787862380.732440:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda4ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732459:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.732468:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:0.0:1787862380.732470:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862380.732473:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9e00, rc 0) 00000100:00100000:0.0:1787862380.732590:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11444:x1874709223376896:12345-192.168.202.9@tcp:101:bash.0 Request processed in 19947us (20496us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787862380.732602:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 143 00010000:00010000:3.0:1787862380.740765:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862380.740769:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1787862380.740789:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.740798:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.740806:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862380.740812:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.740820:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.740843:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862380.740846:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862380.740851:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.740858:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda4f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862380.742315:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223377024 00000100:00100000:2.0:1787862380.742335:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223377024 00000100:00100000:2.0:1787862380.742467:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:2.0:1787862380.742480:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2355:x1874709223377024:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862380.742511:0:12084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862380.742547:0:12084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07a8 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862380.742590:0:12084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787862380.742620:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787862380.742626:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862380.742641:0:12084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 6 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.742665:0:12084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 6 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862380.742682:0:12084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f600, rc 0) 00000100:00100000:2.0:1787862380.742790:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223377024:12345-192.168.202.9@tcp:101:bash.0 Request processed in 312us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862380.742797:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00080000:3.0:1787862380.744964:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862380.747301:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862380.747398:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223377152 00000100:00100000:0.0:1787862380.747420:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223377152 00000100:00100000:0.0:1787862380.747623:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1787862380.747710:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d859680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:11444:x1874709223377152:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862380.747746:0:9223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862380.747766:0:9223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07af expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.747800:0:9223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 7 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.747810:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862380.747814:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862380.747819:0:9223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 7 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.747856:0:9223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 7 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.747871:0:9223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 7 pid: 12084 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862380.747888:0:9223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9223:1874709246457856:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862380.748437:0:9223:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862380.758811:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862380.758904:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223377280 00000100:00100000:3.0:1787862380.758914:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223377280 00010000:00010000:3.0:1787862380.759077:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 8 pid: 12084 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862380.759115:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:3.0:1787862380.759139:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223377280:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862380.759163:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862380.759188:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 8 pid: 12084 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.759203:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 8 pid: 12084 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.759233:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862380.759238:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862380.759248:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.759259:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.759293:0:9223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec871da7/0x391a6cd368cda50d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a8 expref: 8 pid: 12084 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.759307:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 7 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862380.759309:0:9223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9223:1874709246457856:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862380.759336:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d8583c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5853:1874709246457984:192.168.202.9@tcp:105: 00010000:00010000:0.0:1787862380.759336:0:9223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 7 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862380.759351:0:9223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8c00, rc 0) 00000100:00100000:3.0:1787862380.759639:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862380.765838:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d859680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:11444:x1874709223377152:12345-192.168.202.9@tcp:101:bash.0 Request processed in 18193us (18534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862380.765853:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1787862380.767305:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d8583c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5853:1874709246457984:192.168.202.9@tcp:105: 00010000:00010000:0.0:1787862380.767331:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862380.767375:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223377280:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 8239us (8573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862380.767384:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:2.0:1787862380.786191:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862380.790993:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223377536 00000100:00100000:0.0:1787862380.791010:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223377536 00000100:00100000:0.0:1787862380.791139:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:0.0:1787862380.791160:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:11444:x1874709223377536:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:0.0:1787862380.791592:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11444:x1874709223377536:12345-192.168.202.9@tcp:35:bash.0 Request processed in 442us (5409us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787862380.791600:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:1.0:1787862380.986607:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862380.986778:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223377792 00000100:00100000:3.0:1787862380.986792:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223377792 00000100:00100000:3.0:1787862380.986875:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 144 00000100:00100000:3.0:1787862380.986887:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11455:x1874709223377792:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862380.986919:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862380.986949:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda51b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07b6 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862380.987211:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787862380.987370:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda51b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07b6 expref: 20 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.987389:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:3.0:1787862380.987392:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862380.987398:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda51b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07b6 expref: 20 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862380.987415:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:3.0:1787862380.987760:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11455:x1874709223377792:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 873us (1169us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787862380.987770:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 144 00000100:00100000:3.0:1787862381.002349:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.002601:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223378048 00000100:00100000:0.0:1787862381.002614:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223378048 00000100:00100000:0.0:1787862381.002691:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:0.0:1787862381.002703:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11455:x1874709223378048:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1787862381.003128:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11455:x1874709223378048:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 424us (792us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787862381.003136:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:2.0:1787862381.187808:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.188011:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223378176 00000100:00100000:3.0:1787862381.188080:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223378176 00000100:00100000:3.0:1787862381.188168:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 145 00000100:00100000:3.0:1787862381.188181:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11461:x1874709223378176:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862381.188216:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862381.188246:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07bd expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.188348:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.188366:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.188381:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862381.188462:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787862381.188468:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862381.188497:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.188529:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07bd expref: 22 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.188551:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07bd expref: 21 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.188560:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862381.188564:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862381.188569:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2dc00, rc 0) 00000100:00100000:3.0:1787862381.188671:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11461:x1874709223378176:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 492us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862381.188680:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 145 00000100:00100000:1.0:1787862381.199702:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862381.199882:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223378432 00000100:00100000:2.0:1787862381.199896:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223378432 00000100:00100000:2.0:1787862381.199984:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 146 00000100:00100000:2.0:1787862381.199997:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11461:x1874709223378432:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862381.200029:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862381.200104:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda537 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07c4 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.200267:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda53e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.200287:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.200303:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862381.200319:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787862381.200501:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda537 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07c4 expref: 24 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.200522:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07c4 expref: 23 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.200554:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:2.0:1787862381.200557:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862381.200562:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e200, rc 0) 00000100:00100000:2.0:1787862381.201102:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:11461:x1874709223378432:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1106us (1414us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787862381.201111:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 146 00000100:00100000:1.0:1787862381.221474:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862381.221534:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.221838:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223378816 00000100:00100000:0.0:1787862381.221853:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223378816 00000100:00100000:0.0:1787862381.221967:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1787862381.221979:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbaa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:2355:x1874709223378816:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862381.222000:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862381.222037:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda53e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07c4 expref: 23 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.222118:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:0.0:1787862381.222125:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862381.222213:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbaa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:2355:x1874709223378816:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 236us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862381.222222:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1787862381.223035:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223378688 00000100:00100000:3.0:1787862381.223073:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223378688 00000100:00100000:3.0:1787862381.223129:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 147 00000100:00100000:3.0:1787862381.223140:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11461:x1874709223378688:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862381.223181:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862381.223207:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda54c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07cb expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.223354:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda553 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.223373:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.223388:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862381.223404:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787862381.223588:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda54c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07cb expref: 25 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.223611:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07cb expref: 24 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.223622:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:3.0:1787862381.223625:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787862381.223654:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862381.225540:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:11461:x1874709223378688:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 2386us (4066us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787862381.225572:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 147 00000100:00100000:1.0:1787862381.247737:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.247872:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223378944 00000100:00100000:0.0:1787862381.247885:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223378944 00000100:00100000:0.0:1787862381.247974:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1787862381.247986:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2353:x1874709223378944:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:0.0:1787862381.248086:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.248114:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 6 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.248125:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787862381.248131:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862381.248137:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.248219:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 6 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.248235:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 6 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862381.248253:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874709246458112:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862381.248381:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862381.253769:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862381.254005:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223379072 00000100:00100000:1.0:1787862381.254019:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223379072 00002000:00100000:1.0:1787862381.254215:0:6716:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89a10871f840 x1874709223379072/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:497/0 lens 504/0 e 0 to 0 dl 1787862392 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862381.254228:0:6716:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a10871f840 with x1874709223379072 ext(0->12) 00010000:00010000:1.0:1787862381.254240:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 7 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.254261:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 7 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862381.254270:0:6716:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a10871f840 00000100:00100000:1.0:1787862381.254329:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1787862381.254340:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223379072:12345-192.168.202.9@tcp:4:lfs.0 00000100:00100000:1.0:1787862381.255469:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223379072:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 1120us (1706us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787862381.255484:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00002000:00100000:1.0:1787862381.255496:0:6716:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89a10871f840 x1874709223379072/t4294967305(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:497/0 lens 504/448 e 0 to 0 dl 1787862392 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862381.255507:0:6716:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a10871f840 with x1874709223379072 ext(0->12) 00010000:00010000:1.0:1787862381.255517:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 9 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862381.255690:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874709246458112:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862381.255725:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862381.259221:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.259335:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223379200 00000100:00100000:0.0:1787862381.259347:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223379200 00010000:00010000:0.0:1787862381.259410:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 10 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862381.259465:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:0.0:1787862381.259477:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2353:x1874709223379200:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862381.259502:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787862381.259540:0:5855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787862381.259544:0:5855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787862381 00002000:00010000:0.0:1787862381.259547:0:5855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787862381 00002000:00010000:0.0:1787862381.259549:0:5855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787862381 00010000:00010000:0.0:1787862381.259557:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 10 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.259812:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 10 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862381.259826:0:6716:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a10871f840 00010000:00010000:0.0:1787862381.260181:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 9 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.260218:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000149c0f87/0x391a6cd368cda514 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07af expref: 9 pid: 9223 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.260242:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862381.260247:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862381.260254:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.260266:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.260433:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862381.260521:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223379200:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1044us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862381.260540:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00010000:00010000:2.0:1787862381.262509:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262607:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262658:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262739:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262749:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262778:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862381.262784:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262856:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262883:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862381.262892:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda561 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862381.263293:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223378944:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 15299us (15560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862381.263306:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:2.0:1787862381.267878:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.268186:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223379456 00000100:00100000:0.0:1787862381.268201:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223379456 00000100:00100000:0.0:1787862381.268288:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:0.0:1787862381.268302:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:11461:x1874709223379456:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:0.0:1787862381.268419:0:5871:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07cb expref: 24 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862381.282492:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787862381.282756:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787862381.288501:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787862381.288868:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.289165:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 28 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.289177:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.289241:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 28 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.289262:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 28 pid: 5869 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862381.289280:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbaa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5871:1874709246458240:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862381.289439:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862381.297590:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbaa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5871:1874709246458240:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862381.297647:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862381.304583:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.304846:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223379584 00000100:00100000:0.0:1787862381.304860:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223379584 00010000:00010000:0.0:1787862381.304924:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 29 pid: 5869 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862381.305006:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:0.0:1787862381.305020:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:2353:x1874709223379584:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862381.305098:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862381.305108:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 29 pid: 5869 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.305123:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 29 pid: 5869 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.305166:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda4ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07a1 expref: 29 pid: 5869 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.305186:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:0.0:1787862381.305194:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.305205:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.305213:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.305248:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862381.305328:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:2353:x1874709223379584:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 310us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862381.305337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00010000:00010000:3.0:1787862381.306140:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.306163:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862381.306355:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787862381.306658:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787862381.307315:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d858780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246458368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787862381.310771:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862381.310840:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105dd0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862381.311001:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246458368 00000100:00100000:0.0:1787862381.311096:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246458368 00000100:00100000:0.0:1787862381.311178:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862381.311189:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5871:x1874709246458368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862381.311322:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5871:x1874709246458368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862381.311330:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862381.311454:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d858780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246458368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787862381.312249:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787862381.312373:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d858780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246458496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787862381.312445:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862381.312479:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862381.312781:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246458496 00000100:00100000:0.0:1787862381.312801:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246458496 00000100:00100000:0.0:1787862381.312838:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862381.312846:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d8583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5871:x1874709246458496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862381.313083:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d8583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5871:x1874709246458496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 237us (636us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787862381.313092:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862381.313267:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d858780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5871:1874709246458496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787862381.313359:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787862381.313405:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.313417:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.313432:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.313440:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862381.313445:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.313455:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.313477:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:3.0:1787862381.313481:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787862381.313487:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.313495:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda568 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862381.314318:0:5871:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787862381.314506:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787862381.314523:0:5871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432349482106ns, next at 433349479343ns, rc = 0 00000001:00080000:3.0:1787862381.314995:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787862381.315264:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882500) 00010000:00010000:0.0:1787862381.315270:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787862381.315283:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda553 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07cb expref: 32 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862381.315457:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:11461:x1874709223379456:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 47158us (47602us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787862381.315469:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000020:00080000:0.0:1787862381.315476:0:5871:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787862381.318937:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.319080:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223379712 00000100:00100000:3.0:1787862381.319094:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223379712 00000100:00100000:3.0:1787862381.319174:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 148 00000100:00100000:3.0:1787862381.319187:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:11461:x1874709223379712:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862381.319223:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862381.319256:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda56f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07d2 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.319375:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda56f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07d2 expref: 32 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.319394:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda56f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07d2 expref: 32 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.319419:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862381.319423:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862381.319428:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:3.0:1787862381.319511:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11461:x1874709223379712:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 326us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862381.319520:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 148 00000100:00100000:2.0:1787862381.323291:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.323669:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223379968 00000100:00100000:3.0:1787862381.323689:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223379968 00000100:00100000:3.0:1787862381.323786:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:3.0:1787862381.323810:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11461:x1874709223379968:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862381.324253:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:11461:x1874709223379968:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 455us (979us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787862381.324263:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1787862381.490390:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.490528:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223380224 00000100:00100000:0.0:1787862381.490551:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223380224 00000100:00100000:0.0:1787862381.490632:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 149 00000100:00100000:0.0:1787862381.490644:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+33:11471:x1874709223380224:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862381.490688:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862381.490743:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07d9 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862381.490935:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787862381.491164:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda576 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07d9 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.491183:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:0.0:1787862381.491187:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862381.491192:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07d9 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.491211:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9e00, rc 0) 00000100:00100000:0.0:1787862381.491299:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11471:x1874709223380224:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 658us (925us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787862381.491309:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 149 00000100:00100000:2.0:1787862381.503804:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.503981:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223380352 00000100:00100000:3.0:1787862381.503994:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223380352 00000100:00100000:3.0:1787862381.504120:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:3.0:1787862381.504132:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11471:x1874709223380352:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1787862381.504247:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504291:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504307:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504326:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504333:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504340:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504462:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504469:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504475:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862381.504545:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504562:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504569:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504587:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504595:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862381.504600:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504609:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504625:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862381.504628:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862381.504635:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504641:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.504657:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.505922:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.505943:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.505950:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862381.505956:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.505986:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506016:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a108824b00) 00010000:00010000:3.0:1787862381.506019:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862381.506024:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506032:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda58b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506079:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506086:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506093:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506098:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862381.506101:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506107:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506115:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862381.506118:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862381.506121:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.506138:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862381.506684:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11471:x1874709223380352:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 2546us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862381.506697:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:2.0:1787862381.515660:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.515756:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223380608 00000100:00100000:3.0:1787862381.515771:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223380608 00000100:00100000:3.0:1787862381.515855:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1787862381.515867:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11471:x1874709223380608:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862381.516490:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:11471:x1874709223380608:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 623us (845us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787862381.516500:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:1.0:1787862381.560139:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.560331:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223380864 00000100:00100000:0.0:1787862381.560344:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223380864 00000100:00100000:0.0:1787862381.560431:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 151 00000100:00100000:0.0:1787862381.560443:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:11474:x1874709223380864:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862381.560483:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862381.560513:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda599 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07e0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560628:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560648:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560695:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560715:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560723:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560730:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560922:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560932:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.560940:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862381.560953:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787862381.561138:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561161:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561170:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561177:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862381.561190:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561201:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561218:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:0.0:1787862381.561222:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862381.561229:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561237:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda5a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561259:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561265:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561272:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561278:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862381.561281:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561288:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561297:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a116882500) 00010000:00010000:0.0:1787862381.561300:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862381.561310:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561318:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561376:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda599 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 38 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561393:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 37 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862381.561402:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862381.561404:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862381.561407:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9800, rc 0) 00000100:00100000:0.0:1787862381.561507:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11474:x1874709223380864:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1065us (1385us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787862381.561517:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 151 00000100:00100000:2.0:1787862381.569489:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862381.569640:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223380992 00000100:00100000:1.0:1787862381.569654:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223380992 00000100:00100000:1.0:1787862381.569757:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 152 00000100:00100000:1.0:1787862381.569772:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11474:x1874709223380992:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1787862381.569908:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.569939:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.569956:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.569990:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.569998:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.570017:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.570024:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862381.570030:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.570083:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.570102:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862381.570105:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862381.570113:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.570120:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862381.570247:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11474:x1874709223380992:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 475us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862381.570256:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 152 00000100:00100000:2.0:1787862381.574580:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.574711:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223381248 00000100:00100000:0.0:1787862381.574727:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223381248 00000100:00100000:0.0:1787862381.574811:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:0.0:1787862381.574823:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11474:x1874709223381248:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1787862381.575268:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:11474:x1874709223381248:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 444us (704us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787862381.575278:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00010000:00010000:0.0:1787862381.702933:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862381.908958:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862381.909017:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.909168:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223381376 00000100:00100000:0.0:1787862381.909181:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223381376 00000100:00100000:0.0:1787862381.909272:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 304 00000100:00100000:0.0:1787862381.909283:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223381376:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862381.909391:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223381376:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 108us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862381.909400:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 304 00000100:00100000:2.0:1787862381.910416:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.910678:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223381504 00000100:00100000:3.0:1787862381.910687:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223381504 00000100:00100000:3.0:1787862381.910769:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:3.0:1787862381.910780:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223381504:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862381.910862:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223381504:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 84us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862381.910870:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00080000:2.0:1787862381.914331:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862381.919784:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223381632 00000100:00100000:1.0:1787862381.919815:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223381632 00000100:00100000:1.0:1787862381.919912:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 179 00000100:00100000:1.0:1787862381.919926:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223381632:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862381.920122:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223381632:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 188us (11093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862381.920131:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 179 00000100:00100000:2.0:1787862381.941737:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862381.941941:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223381888 00000100:00100000:1.0:1787862381.941954:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223381888 00000100:00100000:1.0:1787862381.942034:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 153 00000100:00100000:1.0:1787862381.942069:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:11505:x1874709223381888:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1787862381.942101:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862381.942326:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07e7 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.942478:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda5ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.942497:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.942512:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862381.942591:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787862381.942993:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda5c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e7 expref: 41 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.943016:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda5ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e7 expref: 40 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862381.943485:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862381.943490:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862381.943495:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8000, rc 0) 00000100:00100000:1.0:1787862381.943603:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11505:x1874709223381888:12345-192.168.202.9@tcp:101:cat.0 Request processed in 1534us (1881us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787862381.943637:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 153 00000100:00100000:0.0:1787862381.950937:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862381.950996:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862381.951163:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223382272 00000100:00100000:3.0:1787862381.951176:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223382272 00000100:00100000:3.0:1787862381.951268:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1787862381.951281:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:2354:x1874709223382272:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862381.951303:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862381.951359:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda5ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e7 expref: 40 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862381.951383:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862381.951389:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862381.951470:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:2354:x1874709223382272:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 191us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862381.951478:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1787862381.951762:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223382144 00000100:00100000:2.0:1787862381.951769:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223382144 00000100:00100000:2.0:1787862381.951820:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:2.0:1787862381.951829:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:11505:x1874709223382144:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:2.0:1787862381.952342:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11505:x1874709223382144:12345-192.168.202.9@tcp:35:cat.0 Request processed in 513us (1422us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787862381.952349:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:2.0:1787862382.074805:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862382.075381:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223382528 00000100:00100000:3.0:1787862382.075394:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223382528 00000100:00100000:3.0:1787862382.075499:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 154 00000100:00100000:3.0:1787862382.075512:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11511:x1874709223382528:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:3.0:1787862382.075546:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862382.075550:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787862382.075590:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07bd expref: 40 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.075616:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862382.075622:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862382.075640:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07ee expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.075781:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.075799:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 40 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.075833:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.075877:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 40 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.075892:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 40 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862382.075908:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d85a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246458624:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862382.076037:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2b780 going to sleep for 11 seconds 00000100:00080000:2.0:1787862382.078798:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862382.092317:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d85a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246458624:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862382.092368:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862382.092536:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862382.093171:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223382656 00000100:00100000:0.0:1787862382.093184:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223382656 00010000:00010000:0.0:1787862382.093245:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 41 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862382.093297:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:0.0:1787862382.093310:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+41:2353:x1874709223382656:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862382.093336:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862382.093345:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 41 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.093361:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 41 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.093393:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07e0 expref: 41 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.093413:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862382.093418:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.093467:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.093476:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.093513:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862382.093592:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:2353:x1874709223382656:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 283us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862382.093601:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00010000:00010000:3.0:1787862382.094668:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.094684:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862382.094716:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787862382.094941:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 41 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.094963:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 40 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.094993:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862382.094996:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787862382.095000:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d600, rc 0) 00000100:00100000:3.0:1787862382.095272:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11511:x1874709223382528:12345-192.168.202.9@tcp:101:dd.0 Request processed in 19762us (20482us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787862382.095282:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 154 00000100:00100000:1.0:1787862382.107707:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862382.107803:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223382912 00000100:00100000:3.0:1787862382.107817:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223382912 00000100:00100000:3.0:1787862382.107894:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 155 00000100:00100000:3.0:1787862382.107906:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11511:x1874709223382912:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:3.0:1787862382.108597:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.108622:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.108635:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862382.108698:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787862382.108727:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000efc127b2 reply state 000000008629b709 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862382.108738:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862382.108868:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:11511:x1874709223382912:12345-192.168.202.9@tcp:36:dd.0 Request processed in 961us (1174us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787862382.108876:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 155 00000020:00080000:3.0:1787862382.108902:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862382.116730:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.116754:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.116763:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.116770:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862382.116776:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.116794:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.116817:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862382.116821:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862382.116827:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.116834:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda5ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862382.453082:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862382.453339:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223383040 00000100:00100000:0.0:1787862382.453357:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223383040 00000100:00100000:0.0:1787862382.453446:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 156 00000100:00100000:0.0:1787862382.453459:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+42:11525:x1874709223383040:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:0.0:1787862382.453500:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862382.453532:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07f5 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453624:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453642:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453656:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453672:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453706:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453714:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453873:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453886:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 43 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453895:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453943:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 43 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.453961:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 43 pid: 5870 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862382.453979:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246458752:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862382.454737:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862382.464509:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862382.467800:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246458752:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862382.467851:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862382.468102:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223383296 00000100:00100000:2.0:1787862382.468114:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223383296 00000100:00100000:2.0:1787862382.468217:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:2.0:1787862382.468230:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:5595:x1874709223383296:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787862382.468763:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:5595:x1874709223383296:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 529us (4268us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787862382.468778:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:2.0:1787862382.477446:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862382.477715:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223383424 00000100:00100000:3.0:1787862382.477731:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223383424 00010000:00010000:3.0:1787862382.477796:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 45 pid: 5870 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862382.477860:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:3.0:1787862382.477872:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:2352:x1874709223383424:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862382.477918:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862382.477927:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 45 pid: 5870 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.477944:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 45 pid: 5870 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.477976:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda5df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07ee expref: 45 pid: 5870 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.477999:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862382.478005:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.478017:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.478026:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.478396:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862382.478785:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478798:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862382.478866:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787862382.478873:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862382.478908:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478926:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478938:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478944:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478951:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478973:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862382.478978:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478986:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.478999:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862382.479001:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862382.479006:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479011:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda5fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479029:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479034:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479074:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479080:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862382.479083:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479089:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479110:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a116882500) 00010000:00010000:1.0:1787862382.479113:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862382.479116:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479122:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479187:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda5f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07f5 expref: 45 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479202:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07f5 expref: 44 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.479209:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862382.479212:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862382.479214:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9200, rc 0) 00000100:00100000:3.0:1787862382.479517:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:2352:x1874709223383424:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1643us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862382.479538:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:1.0:1787862382.479674:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:11525:x1874709223383040:12345-192.168.202.9@tcp:101:stat.0 Request processed in 26217us (26653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862382.479683:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 156 00000100:00100000:1.0:1787862382.568658:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862382.569021:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223383680 00000100:00100000:3.0:1787862382.569034:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223383680 00000100:00100000:3.0:1787862382.569264:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 157 00000100:00100000:3.0:1787862382.569279:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:11531:x1874709223383680:12345-192.168.202.9@tcp:36:truncate.0 00010000:00010000:3.0:1787862382.569397:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862382.569440:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07f5 expref: 43 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.569467:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862382.569473:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862382.570458:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.570484:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.570498:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862382.570578:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787862382.570606:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006c6768de reply state 000000002b7f6b99 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862382.570617:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862382.570809:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:11531:x1874709223383680:12345-192.168.202.9@tcp:36:truncate.0 Request processed in 1528us (2163us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787862382.570820:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 157 00000020:00080000:3.0:1787862382.570828:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862382.583071:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.583097:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.583106:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.583147:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862382.583154:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.583165:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.583188:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862382.583192:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862382.583197:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.583204:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda610 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862382.598118:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246459008:0@lo:400:kworker.0 00000100:00100000:2.0:1787862382.598245:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862382.598320:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246459520:0@lo:400:kworker.0 00000100:00100000:2.0:1787862382.598364:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862382.598400:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862382.598407:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246459136:0@lo:400:kworker.0 00000100:00100000:2.0:1787862382.598431:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862382.598469:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246459008 00000100:00100000:2.0:1787862382.598478:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246459008 00000100:00100000:2.0:1787862382.598538:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246459136 00000100:00100000:2.0:1787862382.598542:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246459136 00000100:00100000:2.0:1787862382.598580:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787862382.598591:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246459008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.598780:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246459520 00000100:00100000:0.0:1787862382.598785:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246459520 00000100:00100000:0.0:1787862382.598828:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787862382.598837:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246459520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.598890:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246459520:12345-0@lo:400:kworker.0 Request processed in 55us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862382.598899:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787862382.598977:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862382.598983:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862382.598997:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787862382.599005:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246459136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.599065:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246459136:12345-0@lo:400:kworker.0 Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862382.599073:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787862382.599278:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246459264:0@lo:400:kworker.0 00000100:00100000:1.0:1787862382.599320:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862382.599353:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787862382.599360:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246458880:0@lo:400:kworker.0 00000100:00100000:1.0:1787862382.599396:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862382.599423:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246459392:0@lo:400:kworker.0 00000100:00100000:1.0:1787862382.599461:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862382.599555:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246458880 00000100:00100000:1.0:1787862382.599561:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246458880 00000100:00100000:1.0:1787862382.599598:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787862382.599605:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862382.599645:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3329:x1874709246458880:12345-0@lo:400:kworker.0 Request processed in 39us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862382.599652:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787862382.599770:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246459264 00000100:00100000:0.0:1787862382.599774:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246459264 00000100:00100000:0.0:1787862382.599812:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787862382.599818:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246459264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.599855:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246459264:12345-0@lo:400:kworker.0 Request processed in 37us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862382.599862:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787862382.599878:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862382.599911:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246459392 00000100:00100000:0.0:1787862382.599915:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246459392 00000100:00080000:0.0:1787862382.599932:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862382.599953:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787862382.599959:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246459392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.599997:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246459392:12345-0@lo:400:kworker.0 Request processed in 37us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862382.600004:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787862382.600085:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246458880:0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.600114:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246459392:0@lo:400:kworker.0 00000100:00100000:0.0:1787862382.600125:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246459264:0@lo:400:kworker.0 00000100:00100000:2.0:1787862382.600309:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246459008:12345-0@lo:400:kworker.0 Request processed in 74us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862382.600321:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787862382.600363:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246459136:0@lo:400:kworker.0 00000100:00100000:2.0:1787862382.600381:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246459008:0@lo:400:kworker.0 00000100:00100000:2.0:1787862382.600394:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246459520:0@lo:400:kworker.0 00010000:00010000:2.0:1787862382.724303:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862382.761870:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862382.762009:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223383808 00000100:00100000:0.0:1787862382.762022:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223383808 00000100:00100000:0.0:1787862382.762213:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 158 00000100:00100000:0.0:1787862382.762225:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:11545:x1874709223383808:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:0.0:1787862382.762267:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862382.762298:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c07fc expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762385:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762404:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762421:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762441:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762448:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762455:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762585:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762606:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762612:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862382.762661:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787862382.762667:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862382.762694:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762709:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762718:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762725:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762731:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762737:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862382.762742:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762749:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762763:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:0.0:1787862382.762772:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862382.762778:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762784:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda61e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762802:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762807:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762812:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762818:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862382.762820:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762826:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762833:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a116882400) 00010000:00010000:0.0:1787862382.762836:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862382.762839:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762844:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762884:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 46 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762911:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 45 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.762920:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862382.762922:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862382.762925:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8800, rc 0) 00000100:00100000:0.0:1787862382.763009:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:11545:x1874709223383808:12345-192.168.202.9@tcp:101:stat.0 Request processed in 786us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862382.763018:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 158 00000100:00100000:0.0:1787862382.857807:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862382.858083:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223384064 00000100:00100000:2.0:1787862382.858098:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223384064 00000100:00100000:2.0:1787862382.858189:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 159 00000100:00100000:2.0:1787862382.858203:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+45:11555:x1874709223384064:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862382.858235:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862382.858267:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0803 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862382.858436:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787862382.858630:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda633 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0803 expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.858649:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:2.0:1787862382.858653:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862382.858660:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0803 expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.858691:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f400, rc 0) 00000100:00100000:2.0:1787862382.858777:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+46:11555:x1874709223384064:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 577us (986us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787862382.858786:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 159 00000100:00100000:0.0:1787862382.870373:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862382.870474:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223384320 00000100:00100000:1.0:1787862382.870487:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223384320 00000100:00100000:1.0:1787862382.870578:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1787862382.870590:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+46:11555:x1874709223384320:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862382.870975:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:11555:x1874709223384320:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 385us (616us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787862382.870983:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1787862382.927202:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862382.927380:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223384576 00000100:00100000:0.0:1787862382.927393:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223384576 00000100:00100000:0.0:1787862382.927478:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00100000:0.0:1787862382.927491:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:11561:x1874709223384576:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862382.927535:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862382.927564:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda641 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c080a expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.928196:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.928217:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 48 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.928227:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.928302:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 48 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862382.928318:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 48 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862382.928339:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1066d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246459648:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862382.928478:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862382.932479:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862382.932740:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223384704 00000100:00100000:2.0:1787862382.932753:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223384704 00010000:00010000:2.0:1787862382.932941:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 49 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862382.933118:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1066d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246459648:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862382.933164:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862382.933273:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:2.0:1787862382.933284:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+49:2353:x1874709223384704:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862382.933302:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862382.933309:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 49 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.933321:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 49 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.933347:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda62c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07fc expref: 49 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.933388:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862382.933392:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.933401:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.933408:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.933431:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862382.933489:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:2353:x1874709223384704:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 207us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862382.933494:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00010000:00010000:1.0:1787862382.935577:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.935601:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862382.935635:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787862382.935904:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda641 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 49 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.935930:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 48 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.935939:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862382.935943:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862382.935947:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9200, rc 0) 00000100:00100000:1.0:1787862382.936097:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:11561:x1874709223384576:12345-192.168.202.9@tcp:101:bash.0 Request processed in 8554us (8857us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787862382.936107:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00100000:0.0:1787862382.939841:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862382.939966:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223384960 00000100:00100000:3.0:1787862382.939980:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223384960 00000100:00100000:3.0:1787862382.940213:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 161 00000100:00100000:3.0:1787862382.940227:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:11561:x1874709223384960:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:3.0:1787862382.940594:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.940611:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.940623:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862382.940671:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787862382.942922:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ccace87b reply state 00000000ab3114c4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862382.942980:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862382.943773:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:11561:x1874709223384960:12345-192.168.202.9@tcp:36:bash.0 Request processed in 3543us (3941us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787862382.943784:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 161 00000020:00080000:3.0:1787862382.943792:0:5870:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787862382.961611:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1787862382.961625:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.961641:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.961649:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.961656:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00000100:00100000:2.0:1787862382.961714:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223385088 00000100:00100000:2.0:1787862382.961727:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223385088 00000100:00100000:2.0:1787862382.961801:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 162 00000100:00100000:2.0:1787862382.961813:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:11561:x1874709223385088:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862382.961844:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862382.961866:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.961870:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda65d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0811 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.961878:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.961898:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862382.961901:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862382.961906:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862382.961912:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.961978:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.962006:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 51 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.962069:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.962113:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 51 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.962140:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 51 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862382.962157:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb70b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246459776:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862382.962251:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1032c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862382.965230:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862382.965347:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb70b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246459776:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862382.965386:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862382.965483:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223385216 00000100:00100000:1.0:1787862382.965493:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223385216 00010000:00010000:1.0:1787862382.965537:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 52 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862382.965583:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:1.0:1787862382.965594:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:2353:x1874709223385216:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862382.965612:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862382.965620:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 52 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.965635:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 52 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.965664:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda648 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c080a expref: 52 pid: 5869 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.965720:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862382.965726:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.965737:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.965745:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862382.965775:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862382.965841:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:2353:x1874709223385216:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 247us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862382.965848:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00010000:00010000:2.0:1787862382.965912:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.965920:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862382.965983:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787862382.965989:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862382.966014:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.966089:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda65d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0811 expref: 51 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.966125:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0811 expref: 50 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862382.966143:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:2.0:1787862382.966146:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862382.966149:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f400, rc 0) 00000100:00100000:2.0:1787862382.966178:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:11561:x1874709223385088:12345-192.168.202.9@tcp:101:bash.0 Request processed in 4367us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862382.966185:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 162 00000100:00100000:0.0:1787862382.972425:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862382.972487:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223385472 00000100:00100000:1.0:1787862382.972501:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223385472 00000100:00100000:1.0:1787862382.972574:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:1.0:1787862382.972586:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:11561:x1874709223385472:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:1.0:1787862382.973339:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:11561:x1874709223385472:12345-192.168.202.9@tcp:35:bash.0 Request processed in 751us (925us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787862382.973349:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1787862383.077009:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862383.077278:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223385728 00000100:00100000:2.0:1787862383.077291:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223385728 00000100:00100000:2.0:1787862383.077368:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 163 00000100:00100000:2.0:1787862383.077380:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:11571:x1874709223385728:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862383.077413:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862383.077441:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda66b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0818 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862383.077605:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787862383.078473:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda66b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0818 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.078496:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:2.0:1787862383.078499:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862383.078505:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda66b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0818 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.078615:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e000, rc 0) 00000100:00100000:2.0:1787862383.078837:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11571:x1874709223385728:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1457us (1842us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787862383.078847:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 163 00000100:00100000:0.0:1787862383.082832:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862383.083676:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223385856 00000100:00100000:1.0:1787862383.083701:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223385856 00000100:00100000:1.0:1787862383.083807:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:1.0:1787862383.083820:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11571:x1874709223385856:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:1.0:1787862383.083940:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.083987:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084017:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084035:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084073:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084080:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084219:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084228:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084236:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862383.084304:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084320:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084327:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084346:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084353:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862383.084358:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084368:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084382:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862383.084386:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862383.084392:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084398:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda679 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084412:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084418:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084424:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084429:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862383.084432:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084449:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084459:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a104fc5700) 00010000:00010000:1.0:1787862383.084461:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862383.084464:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084470:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084486:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084492:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084497:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084502:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862383.084505:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084511:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084518:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862383.084520:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862383.084524:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.084540:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862383.084652:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11571:x1874709223385856:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 832us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862383.084661:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:0.0:1787862383.087269:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862383.087365:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223386112 00000100:00100000:3.0:1787862383.087397:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223386112 00000100:00100000:3.0:1787862383.087464:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:3.0:1787862383.087475:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11571:x1874709223386112:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862383.087839:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:11571:x1874709223386112:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 364us (584us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787862383.087848:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1787862383.111386:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862383.111421:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246459904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862383.111523:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862383.111752:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246459904 00000100:00100000:0.0:1787862383.111763:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246459904 00000100:00100000:0.0:1787862383.111831:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787862383.111843:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246459904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862383.111894:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862383.111967:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246459904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862383.111975:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862383.112348:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a111137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246459904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862383.171566:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862383.171823:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223386368 00000100:00100000:0.0:1787862383.171836:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223386368 00000100:00100000:0.0:1787862383.171949:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:0.0:1787862383.171961:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+53:11574:x1874709223386368:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862383.171997:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862383.172027:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda68e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c081f expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172196:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172215:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172230:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172368:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172377:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172385:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172565:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172575:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172583:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862383.172606:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787862383.172753:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172762:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172769:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172946:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862383.172952:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172962:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172976:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:0.0:1787862383.172980:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862383.172986:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.172993:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173012:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173018:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173035:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173103:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862383.173107:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173114:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173122:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a116882400) 00010000:00010000:0.0:1787862383.173125:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862383.173139:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173146:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda69c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173200:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda68e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c081f expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173216:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c081f expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.173224:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:0.0:1787862383.173226:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862383.173229:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8e00, rc 0) 00000100:00100000:0.0:1787862383.173399:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:11574:x1874709223386368:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1438us (1845us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787862383.173417:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:0.0:1787862383.180161:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862383.180225:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862383.180268:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223386624 00000100:00100000:1.0:1787862383.180282:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223386624 00000100:00100000:1.0:1787862383.180360:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 166 00000100:00100000:1.0:1787862383.180372:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:11574:x1874709223386624:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1787862383.180472:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.180494:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.180510:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862383.180630:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223386496 00000100:00100000:3.0:1787862383.180635:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223386496 00000100:00100000:3.0:1787862383.180686:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1787862383.180694:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:2354:x1874709223386496:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862383.180707:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862383.180729:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda6a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c081f expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862383.180748:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862383.180754:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862383.180845:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:2354:x1874709223386496:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 150us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862383.180854:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00010000:00010000:1.0:1787862383.181222:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.181230:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.181237:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.181262:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862383.181267:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.181275:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.181285:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862383.181288:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862383.181292:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.181299:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862383.181347:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111137840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:11574:x1874709223386624:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 977us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862383.181356:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 166 00000100:00100000:1.0:1787862383.187574:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862383.187675:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223386880 00000100:00100000:3.0:1787862383.187689:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223386880 00000100:00100000:3.0:1787862383.187768:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1787862383.187780:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:11574:x1874709223386880:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862383.188311:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:11574:x1874709223386880:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 531us (751us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787862383.188343:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1787862383.452726:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862383.452915:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223387136 00000100:00100000:1.0:1787862383.452929:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223387136 00000100:00100000:1.0:1787862383.453020:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 167 00000100:00100000:1.0:1787862383.453034:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:11592:x1874709223387136:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1787862383.453114:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862383.453154:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0826 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.453319:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda6bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.453355:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda6bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.453371:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda6bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862383.453386:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787862383.453556:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda6b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0826 expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.453576:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda6bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0826 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.453585:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:1.0:1787862383.453588:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787862383.453592:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8000, rc 0) 00000100:00100000:1.0:1787862383.453673:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11592:x1874709223387136:12345-192.168.202.9@tcp:101:cat.0 Request processed in 642us (967us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787862383.453682:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 167 00000100:00100000:0.0:1787862383.529312:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862383.529627:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223387264 00000100:00100000:2.0:1787862383.529643:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223387264 00000100:00100000:2.0:1787862383.529752:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:2.0:1787862383.529767:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11593:x1874709223387264:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862383.529812:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862383.529845:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda6cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c082d expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.529954:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda6d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.529974:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.529988:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862383.530485:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787862383.530489:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862383.530519:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.530582:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda6cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c082d expref: 59 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.530607:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda6d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c082d expref: 58 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862383.530617:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:2.0:1787862383.530620:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862383.530624:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79fc00, rc 0) 00000100:00100000:2.0:1787862383.530848:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11593:x1874709223387264:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1083us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862383.530858:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:1.0:1787862383.543211:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862383.543605:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223387648 00000100:00100000:0.0:1787862383.543619:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223387648 00000100:00100000:0.0:1787862383.543708:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:0.0:1787862383.543719:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d071a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11593:x1874709223387648:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1787862383.544661:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d071a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11593:x1874709223387648:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 935us (1458us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787862383.544673:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:0.0:1787862383.554951:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862383.559707:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223387776 00000100:00100000:3.0:1787862383.559732:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223387776 00000100:00100000:3.0:1787862383.560532:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1787862383.560549:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11593:x1874709223387776:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:3.0:1787862383.560569:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787862383.560604:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda664 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0811 expref: 59 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862383.560635:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda6bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0826 expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862383.560649:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda56f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c07d2 expref: 57 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862383.560662:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a108824400) 00010000:00010000:3.0:1787862383.560675:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862383.560766:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:11593:x1874709223387776:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 223us (5832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862383.560783:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862383.574361:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862383.574454:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223387904 00000100:00100000:0.0:1787862383.574469:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223387904 00000100:00100000:0.0:1787862383.574556:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:0.0:1787862383.574570:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:11593:x1874709223387904:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:0.0:1787862383.574755:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.574788:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862383.574805:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862383.575121:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787862383.575259:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:11593:x1874709223387904:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 690us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862383.575294:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:2.0:1787862383.599104:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862383.599288:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223388032 00000100:00100000:1.0:1787862383.599302:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223388032 00000100:00100000:1.0:1787862383.599381:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:1.0:1787862383.599393:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:11595:x1874709223388032:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862383.599423:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862383.599453:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0834 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599579:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599598:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599612:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599629:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599637:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599643:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599820:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599831:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599839:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862383.599890:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787862383.599896:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862383.599923:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599955:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599965:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599973:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599980:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.599987:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862383.599992:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600001:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600016:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862383.600020:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862383.600026:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600033:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda6e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600095:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600103:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600116:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600131:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862383.600134:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600141:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600149:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a104fc5700) 00010000:00010000:1.0:1787862383.600152:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862383.600155:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600161:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda6f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600205:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 58 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600221:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 57 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862383.600229:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:1.0:1787862383.600231:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862383.600233:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9a00, rc 0) 00000100:00100000:1.0:1787862383.600337:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11595:x1874709223388032:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 944us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862383.600355:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 170 00010000:00010000:3.0:1787862383.748864:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787862383.755005:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1787862383.755384:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:1.0:1787862384.133941:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862384.133955:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862384.134027:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787862384.134037:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862384.140471:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d070f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246460032:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862384.141451:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862384.148716:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d070f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246460032:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862384.161185:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.161263:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223388160 00000100:00100000:0.0:1787862384.161278:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223388160 00000100:00100000:0.0:1787862384.161367:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 171 00000100:00100000:0.0:1787862384.161381:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11606:x1874709223388160:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1787862384.162669:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1787862384.165185:0:5868:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787862384.167023:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11606:x1874709223388160:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 5627us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862384.167055:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 171 00000100:00100000:1.0:1787862384.177997:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862384.178065:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223388288 00000100:00100000:1.0:1787862384.178077:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223388288 00000100:00100000:1.0:1787862384.178163:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:1.0:1787862384.178178:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d070f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11606:x1874709223388288:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787862384.178294:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178319:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178338:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178622:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178714:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178744:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178781:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178789:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178796:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862384.178839:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787862384.178844:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862384.178858:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178869:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178946:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178957:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178971:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.178976:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.178983:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179003:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:1.0:1787862384.179006:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862384.179011:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179017:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda6fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179033:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179093:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179100:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179105:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.179109:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179125:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179135:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff89a104fc5700) 00010000:00010000:1.0:1787862384.179138:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862384.179142:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179155:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda705 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179186:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179193:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179199:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179205:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.179210:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179217:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179229:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:1.0:1787862384.179232:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862384.179235:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.179242:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda70c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.181062:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d070f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11606:x1874709223388288:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 2858us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862384.181076:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:3.0:1787862384.189857:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862384.190030:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223388544 00000100:00100000:2.0:1787862384.190079:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223388544 00000100:00100000:2.0:1787862384.190168:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:2.0:1787862384.190180:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11606:x1874709223388544:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862384.190208:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862384.190237:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda713 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c083b expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190372:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190391:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190429:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862384.190444:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787862384.190744:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190753:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190761:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190767:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ec00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862384.190772:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190781:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190798:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:2.0:1787862384.190802:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862384.190808:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190814:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda71a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190867:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda713 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c083b expref: 59 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190893:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:2.0:1787862384.190896:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862384.190901:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda713 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c083b expref: 59 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.190911:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e800, rc 0) 00000100:00100000:2.0:1787862384.190996:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11606:x1874709223388544:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 819us (1157us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787862384.191004:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:1.0:1787862384.196524:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862384.196585:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223388672 00000100:00100000:1.0:1787862384.196597:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223388672 00000100:00100000:1.0:1787862384.196714:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:1.0:1787862384.196727:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d073840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11606:x1874709223388672:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862384.196765:0:5869:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862384.196873:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d073840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11606:x1874709223388672:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862384.196881:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:1.0:1787862384.224370:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862384.224424:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223388928 00000100:00100000:1.0:1787862384.224436:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223388928 00000100:00100000:1.0:1787862384.224512:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:1.0:1787862384.224524:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d072d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11606:x1874709223388928:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862384.224552:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862384.224556:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787862384.224595:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda6d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c082d expref: 58 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.224620:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862384.224627:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862384.224658:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda728 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0842 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862384.225691:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787862384.226021:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda72f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.226069:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.226097:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.226197:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda728 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0842 expref: 60 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.226218:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda72f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0842 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.226228:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a104fc5700) 00010000:00010000:1.0:1787862384.226231:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862384.226235:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8000, rc 0) 00000100:00100000:1.0:1787862384.226335:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d072d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11606:x1874709223388928:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1811us (1979us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787862384.226345:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:1.0:1787862384.238960:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862384.239011:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223389184 00000100:00100000:1.0:1787862384.239023:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223389184 00000100:00100000:1.0:1787862384.239107:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 176 00000100:00100000:1.0:1787862384.239132:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d072940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11606:x1874709223389184:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787862384.239215:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862384.239254:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda72f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0842 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.239277:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a104fc5700) 00010000:00010000:1.0:1787862384.239291:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862384.239339:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.239357:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.239369:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.239386:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.239394:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.239401:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240755:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240870:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240879:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240886:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.240892:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240902:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240934:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862384.240937:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862384.240944:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240951:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda73d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240967:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240974:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240980:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240985:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.240988:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.240994:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.241002:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfdbe38f6 (ffff89a104fc5400) 00010000:00010000:1.0:1787862384.241004:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862384.241007:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.241013:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda744 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfdbe38f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.241195:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d072940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11606:x1874709223389184:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 2071us (2244us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787862384.241205:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 176 00000001:00080000:2.0:1787862384.251316:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1787862384.251415:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787862384.251437:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a108729180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787862384.251443:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a119235d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a105dd0900 00000020:00080000:2.0:1787862384.251446:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a119235900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a13b24c000 00000020:00080000:2.0:1787862384.251612:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787862384.253690:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787862384.253730:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246460160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787862384.253839:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862384.253949:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246460160 00000100:00100000:2.0:1787862384.253959:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246460160 00000100:00100000:2.0:1787862384.254028:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787862384.254060:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246460160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787862384.254103:0:6709:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787862384.254160:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a909d6d, atime: 0x6a909d6d, ctime: 0x6a909d6d, blocks: 0xb 00010000:00010000:2.0:1787862384.254187:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254209:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1787862384.254215:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862384.254223:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254243:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254256:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254265:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254286:0:6709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787862384.254872:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246460160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 832us (1030us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787862384.254882:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787862384.254918:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862384.254934:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862384.254942:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254951:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862384.254963:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254974:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.254994:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.255002:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7ba386d/0x391a6cd368cda74b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.255023:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862384.255025:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862384.255026:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862384.255094:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787862384.255101:0:3329:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787862384.255140:0:3329:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89a13cb70780 x1874709246460160/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787862400 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787862384.255153:0:3329:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13cb70780/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787862384.255160:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246460160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787862384.264245:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.264349:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223389312 00000100:00100000:3.0:1787862384.264364:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223389312 00000100:00100000:3.0:1787862384.264446:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 177 00000100:00100000:3.0:1787862384.264458:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:11606:x1874709223389312:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862384.264499:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862384.264541:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda752 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0849 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.264592:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.264610:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.264625:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.264764:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 19 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.264922:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.264934:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:3.0:1787862384.264938:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862384.264944:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d600, rc 0) 00000100:00100000:3.0:1787862384.265028:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11606:x1874709223389312:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 572us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862384.265036:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 177 00000100:00100000:0.0:1787862384.273577:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.274408:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223389568 00000100:00100000:3.0:1787862384.274425:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223389568 00000100:00100000:3.0:1787862384.274503:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 178 00000100:00100000:3.0:1787862384.274516:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11606:x1874709223389568:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862384.274664:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.274688:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.274704:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862384.277438:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787862384.277458:0:5869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435312416590ns, next at 436312413700ns, rc = 0 00000004:00010000:3.0:1787862384.277653:0:5869:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000f1e16cd reply state 00000000fefdb78f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.277669:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862384.278551:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11606:x1874709223389568:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 4024us (4976us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787862384.278565:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 178 00000100:00100000:1.0:1787862384.312358:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1787862384.312451:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.312471:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.312483:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.312530:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862384.312538:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.312549:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.312573:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:2.0:1787862384.312576:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787862384.312584:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.312591:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda760 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.313270:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223389696 00000100:00100000:3.0:1787862384.313287:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223389696 00000100:00100000:3.0:1787862384.313372:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 179 00000100:00100000:3.0:1787862384.313384:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11606:x1874709223389696:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862384.313419:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862384.313444:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0850 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.315349:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.315411:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.315461:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:3.0:1787862384.315464:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862384.315470:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c400, rc 0) 00000100:00100000:3.0:1787862384.316373:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11606:x1874709223389696:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 2980us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862384.316389:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 179 00000100:00100000:0.0:1787862384.336480:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.336540:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223389824 00000100:00100000:0.0:1787862384.336552:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223389824 00000100:00100000:0.0:1787862384.336636:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1787862384.336650:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223389824:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787862384.337154:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223389824:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 503us (688us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787862384.337163:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1787862384.346813:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.346870:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223390080 00000100:00100000:0.0:1787862384.346885:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223390080 00000100:00100000:0.0:1787862384.346955:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1787862384.346965:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11606:x1874709223390080:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787862384.347339:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11606:x1874709223390080:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 373us (535us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787862384.347348:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00080000:2.0:1787862384.347709:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862384.353240:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862384.356429:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223390336 00000100:00100000:2.0:1787862384.356450:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223390336 00000100:00100000:2.0:1787862384.356574:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 180 00000100:00100000:2.0:1787862384.356586:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11606:x1874709223390336:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787862384.356765:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11606:x1874709223390336:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 180us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862384.356774:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 180 00000100:00100000:0.0:1787862384.372933:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.372977:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223390464 00000100:00100000:0.0:1787862384.372990:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223390464 00000100:00100000:0.0:1787862384.373089:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 181 00000100:00100000:0.0:1787862384.373101:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11606:x1874709223390464:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862384.373142:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862384.373172:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda76e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0857 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.373270:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.373291:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.373306:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862384.373357:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862384.373383:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.373421:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda76e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0857 expref: 23 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.373469:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0857 expref: 22 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.373479:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:0.0:1787862384.373482:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787862384.373487:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9400, rc 0) 00000100:00100000:0.0:1787862384.374059:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11606:x1874709223390464:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 934us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862384.374070:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 181 00000100:00100000:2.0:1787862384.386377:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.386469:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223390592 00000100:00100000:3.0:1787862384.386483:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223390592 00000100:00100000:3.0:1787862384.386666:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:3.0:1787862384.386680:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223390592:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862384.386712:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862384.386739:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c085e expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862384.386778:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909d70, blocks: 0x1 00010000:00010000:3.0:1787862384.386808:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1787862384.386814:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862384.386888:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.386915:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.386955:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2dc00, rc 0) 00000100:00100000:3.0:1787862384.387037:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223390592:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 360us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862384.387068:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:1.0:1787862384.400450:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862384.400550:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223390848 00000100:00100000:2.0:1787862384.400562:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223390848 00000100:00100000:2.0:1787862384.400641:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 182 00000100:00100000:2.0:1787862384.400653:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d072580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11606:x1874709223390848:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787862384.400846:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d072580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11606:x1874709223390848:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 194us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862384.400854:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 182 00000100:00100000:2.0:1787862384.407334:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.412212:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223390976 00000100:00100000:3.0:1787862384.412229:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223390976 00000100:00100000:3.0:1787862384.412309:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:3.0:1787862384.412322:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:11606:x1874709223390976:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862384.412349:0:9223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862384.412374:0:9223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0865 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.412417:0:9223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.412428:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862384.412433:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862384.412439:0:9223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 9 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.412485:0:9223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.412500:0:9223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.412529:0:9223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d858f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246460288:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862384.412656:0:9223:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729840 going to sleep for 11 seconds 00000100:00100000:1.0:1787862384.429066:0:9223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d858f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246460288:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862384.429132:0:9223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 9 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.429161:0:9223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2da00, rc 0) 00000100:00100000:1.0:1787862384.429240:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:11606:x1874709223390976:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 16919us (21919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862384.429252:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:2.0:1787862384.442355:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.443380:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223391104 00000100:00100000:3.0:1787862384.443399:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223391104 00010000:00010000:3.0:1787862384.443461:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.443532:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:3.0:1787862384.443544:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223391104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862384.443565:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862384.443596:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.443612:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.443643:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e16c0b/0x391a6cd368cda77c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c085e expref: 9 pid: 6711 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.443663:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862384.443669:0:8522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862384.443679:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.443720:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.443773:0:8522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.443792:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d858f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8522:1874709246460416:192.168.202.9@tcp:105: 00000100:00100000:3.0:1787862384.443906:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1087290c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862384.460938:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862384.461201:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223391232 00000100:00100000:1.0:1787862384.461215:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223391232 00002000:00100000:1.0:1787862384.461285:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89a13d0fd680 x1874709223391232/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:500/0 lens 504/0 e 0 to 0 dl 1787862395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862384.461299:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d0fd680 with x1874709223391232 ext(0->8) 00002000:00010000:1.0:1787862384.461307:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13d0fd680 00000100:00100000:1.0:1787862384.461343:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1787862384.461355:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2353:x1874709223391232:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787862384.461679:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d858f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8522:1874709246460416:192.168.202.9@tcp:105: 00010000:00010000:3.0:1787862384.461710:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862384.461958:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223391104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 18414us (19619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862384.461969:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:1.0:1787862384.464496:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2353:x1874709223391232:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 3126us (3664us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787862384.467751:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00002000:00100000:1.0:1787862384.469019:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89a13d0fd680 x1874709223391232/t4294967314(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:500/0 lens 504/448 e 0 to 0 dl 1787862395 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862384.469035:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d0fd680 with x1874709223391232 ext(0->8) 00002000:00010000:1.0:1787862384.469065:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13d0fd680 00000100:00100000:0.0:1787862384.484298:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.486359:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223391360 00000100:00100000:3.0:1787862384.486383:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223391360 00000100:00100000:2.0:1787862384.486569:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 183 00000100:00100000:2.0:1787862384.486584:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11606:x1874709223391360:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787862384.609747:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11606:x1874709223391360:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 123146us (125445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862384.609775:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 183 00000001:00080000:2.0:1787862384.609840:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1787862384.609869:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1787862384.609900:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:2.0:1787862384.610138:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246460544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787862384.610222:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787862384.610429:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787862384.610447:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787862384.611802:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246460544 00000100:00100000:1.0:1787862384.611816:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246460544 00000100:00100000:1.0:1787862384.611904:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862384.611915:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246460544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787862384.612228:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787862384.612232:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787862384 00002000:00010000:1.0:1787862384.612235:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862384.612238:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787862384 -> 1787862384 00002000:00010000:1.0:1787862384.612240:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787862384.612349:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246460544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 434us (2126us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787862384.612358:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787862384.612946:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787862384.613005:0:3330:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13cb71e00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787862384.613014:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246460544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787862384.657306:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.657539:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223391488 00000100:00100000:0.0:1787862384.657554:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223391488 00000100:00100000:0.0:1787862384.657630:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:0.0:1787862384.657642:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2353:x1874709223391488:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787862384.782193:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787862384.831292:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1787862384.831314:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1787862384.831321:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1787862384.831578:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223391488:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 173929us (174279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862384.831594:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:0.0:1787862384.839154:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862384.839675:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223391744 00000100:00100000:2.0:1787862384.839700:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223391744 00000100:00100000:2.0:1787862384.839787:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 184 00000100:00100000:2.0:1787862384.839798:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11606:x1874709223391744:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862384.839890:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862384.839930:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda775 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0857 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.839950:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:2.0:1787862384.839956:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862384.839997:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.840015:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.840026:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862384.841154:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000070a74cc7 reply state 0000000068a8863b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862384.841173:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862384.841396:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11606:x1874709223391744:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1595us (2256us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787862384.841406:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 184 00010000:00010000:3.0:1787862384.848491:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.848531:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.848540:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.848548:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fe00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862384.848575:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.848584:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.848606:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:3.0:1787862384.848610:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862384.848615:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.848622:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fe00/0x391a6cd368cda78a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.860426:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862384.860660:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223391872 00000100:00100000:2.0:1787862384.860673:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223391872 00000100:00100000:2.0:1787862384.860754:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:2.0:1787862384.860767:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223391872:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787862384.861187:0:9223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787862384.861193:0:9223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787862384 -> 1787862383 00002000:00010000:2.0:1787862384.861196:0:9223:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787862381 00002000:00010000:2.0:1787862384.861207:0:9223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787862384 -> 1787862383 00002000:00010000:2.0:1787862384.861210:0:9223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787862384.861303:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223391872:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 537us (893us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787862384.861314:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:2.0:1787862384.867488:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.868106:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223392128 00000100:00100000:0.0:1787862384.868129:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223392128 00000100:00100000:0.0:1787862384.868208:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 185 00000100:00100000:0.0:1787862384.868222:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11606:x1874709223392128:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787862384.868543:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.868569:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.868580:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.868653:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.868671:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 18 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.868689:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5868:1874709246460672:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862384.868822:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862384.873704:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862384.873750:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223392256 00000100:00100000:2.0:1787862384.873761:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223392256 00010000:00010000:2.0:1787862384.873816:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862384.873875:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:2.0:1787862384.873886:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:2352:x1874709223392256:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862384.873905:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862384.873913:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862384.873923:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5868:1874709246460672:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862384.873926:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.873953:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0849 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.873960:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.873969:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:2.0:1787862384.873974:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.874007:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.874016:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862384.890104:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862384.891783:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:2352:x1874709223392256:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 17877us (18075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862384.891816:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00010000:00010000:0.0:1787862384.894094:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894129:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894176:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894184:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894194:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894202:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862384.894208:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894217:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894255:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:0.0:1787862384.894258:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787862384.894264:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.894271:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862384.894400:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:11606:x1874709223392128:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 26173us (26923us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787862384.894412:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 185 00000100:00100000:3.0:1787862384.906908:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.907075:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223392384 00000100:00100000:0.0:1787862384.907089:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223392384 00000100:00100000:0.0:1787862384.907178:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:0.0:1787862384.907190:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d8592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223392384:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787862384.907269:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.907300:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.907311:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862384.907318:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862384.907336:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.907384:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.907401:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 8 pid: 9223 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862384.907419:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1874709246460800:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862384.907714:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee5180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862384.912156:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1874709246460800:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862384.912202:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.923975:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862384.924121:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223392512 00000100:00100000:0.0:1787862384.924136:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223392512 00010000:00010000:0.0:1787862384.924196:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 9 pid: 9223 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862384.924248:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1787862384.924260:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223392512:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862384.924282:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862384.924316:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 9 pid: 9223 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924333:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 9 pid: 9223 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924365:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f844c8c/0x391a6cd368cda783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0865 expref: 9 pid: 9223 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924388:0:5854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862384.924393:0:5854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862384.924400:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924437:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924476:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862384.924555:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223392512:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 297us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862384.924563:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00010000:00010000:0.0:1787862384.924676:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924688:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924718:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924728:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924738:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924746:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862384.924751:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924774:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924788:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862384.924797:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f290d1e/0x391a6cd368cda798 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862384.924855:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d8592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223392384:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 17667us (17963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862384.924865:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:2.0:1787862384.932721:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862384.932952:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223392768 00000100:00100000:1.0:1787862384.932965:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223392768 00000100:00100000:1.0:1787862384.933057:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 186 00000100:00100000:1.0:1787862384.933069:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+17:11606:x1874709223392768:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862384.933191:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933213:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933227:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933547:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933561:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933570:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933626:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.933642:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 18 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.933660:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246460928:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862384.934054:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862384.954077:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246460928:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862384.954127:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.964357:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862384.964716:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223392896 00000100:00100000:3.0:1787862384.964731:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223392896 00010000:00010000:3.0:1787862384.964799:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862384.964851:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:3.0:1787862384.964863:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:2353:x1874709223392896:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862384.964884:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862384.964892:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.964909:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.964959:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda767 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0850 expref: 19 pid: 5868 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.964977:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:3.0:1787862384.964984:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.964996:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.965004:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862384.965071:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862384.965149:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:2353:x1874709223392896:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 287us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862384.965156:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00010000:00010000:1.0:1787862384.966987:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.967008:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862384.967368:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787862384.967588:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787862384.967641:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787862384.967783:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d073c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246461056:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787862384.967881:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862384.967940:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a116a2c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787862384.975145:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246461056 00000100:00100000:2.0:1787862384.975167:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246461056 00000100:00100000:2.0:1787862384.975251:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787862384.975263:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874709246461056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787862384.975457:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874709246461056:12345-0@lo:1000:mdt00_001.0 Request processed in 196us (7575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862384.975467:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787862384.975519:0:5869:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787862384.975528:0:5869:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13cb71e00, transno 4294967315 00000100:00100000:3.0:1787862384.975554:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d073c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246461056:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787862384.978080:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787862384.978215:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d85b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246461184:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787862384.978309:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862384.981264:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862384.981913:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246461184 00000100:00100000:0.0:1787862384.981928:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246461184 00000100:00100000:0.0:1787862384.982732:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862384.982749:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5869:x1874709246461184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787862384.983203:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5869:x1874709246461184:12345-0@lo:1000:mdt00_001.0 Request processed in 455us (4891us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787862384.983212:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787862384.983333:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d85b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5869:1874709246461184:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787862384.983394:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983418:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983427:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983434:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.983439:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983448:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983471:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a108824b00) 00010000:00010000:1.0:1787862384.983474:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862384.983480:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983487:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda7a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983527:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983534:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983540:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983544:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862384.983555:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983561:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983569:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:1.0:1787862384.983572:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862384.983575:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983581:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda6db lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983610:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983627:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 21 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983636:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983678:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 21 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862384.983695:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 21 pid: 5869 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862384.983711:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d071680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246461312:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862384.983810:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862384.990746:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d071680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246461312:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862384.990800:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862385.001473:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862385.001852:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223393024 00000100:00100000:0.0:1787862385.001870:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223393024 00010000:00010000:0.0:1787862385.001935:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 22 pid: 5869 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862385.001987:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:0.0:1787862385.002023:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:2352:x1874709223393024:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862385.002077:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862385.002086:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 22 pid: 5869 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.002102:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 22 pid: 5869 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.003977:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda6f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0834 expref: 22 pid: 5869 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.004004:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:0.0:1787862385.004010:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.004023:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.004032:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.005811:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862385.005925:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:2352:x1874709223393024:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3895us (5615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862385.005940:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00010000:00010000:3.0:1787862385.013411:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013435:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013455:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013463:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013471:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013478:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.013483:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013491:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013849:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:3.0:1787862385.013852:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.013859:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013866:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda7ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013903:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013910:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013916:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013921:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.013925:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013931:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013940:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882400) 00010000:00010000:3.0:1787862385.013943:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862385.013946:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.013952:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda79f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862385.015959:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11606:x1874709223392768:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 82876us (83234us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787862385.015977:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 186 00000020:00080000:3.0:1787862385.015986:0:5869:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787862385.017105:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862385.017429:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862385.020514:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787862385.020545:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862385.024610:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862385.024704:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223393280 00000100:00100000:0.0:1787862385.024717:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223393280 00000100:00100000:0.0:1787862385.024803:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1787862385.024815:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11606:x1874709223393280:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787862385.025643:0:5871:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787862385.025760:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787862385.025819:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.025841:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.025857:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.025867:0:5871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.025875:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.025882:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.025907:0:5871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787862385.026035:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11606:x1874709223393280:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 1219us (1436us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787862385.026071:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000020:00080000:0.0:1787862385.026077:0:5871:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862385.027210:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862385.027224:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.027251:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862385.027256:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.027265:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.027283:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89a116882700) 00010000:00010000:3.0:1787862385.027286:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862385.027292:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.027298:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cda7b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.027338:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862385.027341:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862385.027342:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862385.182424:0:12480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862385.182438:0:12480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862385.182481:0:12480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787862385.182487:0:12480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862385.456012:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.456353:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223393536 00000100:00100000:3.0:1787862385.456366:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223393536 00000100:00100000:3.0:1787862385.456438:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 187 00000100:00100000:3.0:1787862385.456450:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:11616:x1874709223393536:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862385.456485:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862385.456533:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda7bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c086c expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.457270:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda7c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.457293:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.457308:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862385.457323:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787862385.457920:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda7bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c086c expref: 25 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.457943:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c086c expref: 24 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.457953:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862385.457956:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787862385.457961:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2ce00, rc 0) 00000100:00100000:3.0:1787862385.460971:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:11616:x1874709223393536:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 4497us (4949us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787862385.460991:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 187 00000100:00100000:1.0:1787862385.467607:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.467960:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223393664 00000100:00100000:3.0:1787862385.467974:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223393664 00000100:00100000:3.0:1787862385.468090:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 188 00000100:00100000:3.0:1787862385.468103:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d071e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:11616:x1874709223393664:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1787862385.468221:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468258:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468273:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468293:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468300:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468306:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468961:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468973:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.468981:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862385.469032:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469132:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469139:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469159:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469165:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.469171:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469179:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469193:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862385.469196:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.469202:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469208:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda7d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469221:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469227:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469233:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469239:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.469242:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469260:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469269:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a103200500) 00010000:00010000:3.0:1787862385.469271:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.469274:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469281:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cda7d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469300:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469308:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469313:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469319:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.469321:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469328:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469334:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a103200c00) 00010000:00010000:3.0:1787862385.469337:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.469340:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.469356:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda7de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862385.469901:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d071e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:11616:x1874709223393664:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 1794us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862385.469913:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 188 00000100:00100000:3.0:1787862385.587936:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862385.588658:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223393920 00000100:00100000:0.0:1787862385.588672:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223393920 00000100:00100000:0.0:1787862385.588780:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 189 00000100:00100000:0.0:1787862385.588791:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d859680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+24:11619:x1874709223393920:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862385.588819:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862385.588845:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda7e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0873 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.588943:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.588962:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.588977:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.589006:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.589014:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.589021:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.589952:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.589966:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.589975:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862385.590000:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787862385.590164:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590173:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590181:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590187:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862385.590193:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590201:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590215:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:0.0:1787862385.590219:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862385.590344:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590353:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda7ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590372:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590379:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590398:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590402:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862385.590405:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590411:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590419:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a116882800) 00010000:00010000:0.0:1787862385.590422:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862385.590425:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590431:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda7f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590490:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda7e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 27 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590507:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 26 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.590514:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:0.0:1787862385.590516:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862385.590519:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9c00, rc 0) 00000100:00100000:0.0:1787862385.590615:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d859680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11619:x1874709223393920:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1823us (2691us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787862385.590636:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 189 00000100:00100000:1.0:1787862385.600528:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.601917:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223394048 00000100:00100000:3.0:1787862385.601931:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223394048 00000100:00100000:3.0:1787862385.602018:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 190 00000100:00100000:3.0:1787862385.602030:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d070b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11619:x1874709223394048:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1787862385.602158:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602181:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602197:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602398:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602408:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602416:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602423:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.602441:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602450:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602465:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:3.0:1787862385.602469:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862385.602475:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.602483:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862385.602588:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d070b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11619:x1874709223394048:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 558us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862385.602597:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 190 00000100:00100000:1.0:1787862385.605496:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.605577:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223394304 00000100:00100000:3.0:1787862385.605590:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223394304 00000100:00100000:3.0:1787862385.605654:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:3.0:1787862385.605665:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11619:x1874709223394304:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862385.605988:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:11619:x1874709223394304:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 323us (503us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787862385.605998:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:2.0:1787862385.668428:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246461440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862385.668525:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862385.674112:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246461440 00000100:00100000:1.0:1787862385.674136:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246461440 00000100:00100000:1.0:1787862385.674218:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787862385.674240:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246461440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862385.674299:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862385.674421:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246461440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (5895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862385.674430:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862385.677517:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862385.677657:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246461440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862385.679551:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223394560 00000100:00100000:0.0:1787862385.679571:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223394560 00000100:00100000:0.0:1787862385.679654:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 191 00000100:00100000:0.0:1787862385.679667:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:11152:x1874709223394560:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862385.679703:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862385.679733:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda80f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c087a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.679894:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.679912:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.679923:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.679971:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.679987:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 28 pid: 5868 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862385.680005:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0fda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5868:1874709246461568:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862385.680157:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862385.701411:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862385.701594:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0fda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5868:1874709246461568:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862385.701646:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862385.701722:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223394688 00000100:00100000:2.0:1787862385.701733:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223394688 00010000:00010000:2.0:1787862385.701801:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 29 pid: 5868 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862385.701866:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:2.0:1787862385.701878:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d071a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:2353:x1874709223394688:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862385.701900:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862385.701908:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 29 pid: 5868 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862385.701922:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 29 pid: 5868 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862385.701951:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cda7fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0873 expref: 29 pid: 5868 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862385.701970:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:2.0:1787862385.701976:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862385.701987:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862385.701996:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862385.702031:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862385.702149:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d071a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:2353:x1874709223394688:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 272us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862385.702157:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00010000:00010000:1.0:1787862385.702851:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862385.702862:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862385.702888:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787862385.703133:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda80f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 29 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862385.703154:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862385.703163:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:1.0:1787862385.703166:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862385.703168:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9800, rc 0) 00000100:00100000:1.0:1787862385.704318:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:11152:x1874709223394560:12345-192.168.202.9@tcp:101:bash.0 Request processed in 23556us (25720us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787862385.704360:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 191 00000100:00100000:1.0:1787862385.708001:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.708777:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223394944 00000100:00100000:3.0:1787862385.708791:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223394944 00000100:00100000:3.0:1787862385.708905:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:3.0:1787862385.708917:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d071680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:11152:x1874709223394944:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:3.0:1787862385.709340:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.709382:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.709398:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862385.709466:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787862385.709497:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003aeed8ee reply state 0000000031d5d729 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862385.709509:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787862385.709566:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787862385.709714:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d071680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11152:x1874709223394944:12345-192.168.202.9@tcp:36:bash.0 Request processed in 796us (1727us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787862385.709722:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 192 00000020:00080000:3.0:1787862385.709728:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787862385.713569:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.713595:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.713604:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.713611:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.713617:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.713626:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.713671:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:3.0:1787862385.713674:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.713682:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.713700:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda824 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862385.714123:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862385.714267:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223395072 00000100:00100000:0.0:1787862385.714279:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223395072 00000100:00100000:0.0:1787862385.714350:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 193 00000100:00100000:0.0:1787862385.714361:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d073c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:11152:x1874709223395072:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862385.714396:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862385.714420:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda82b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0881 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.714502:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda82b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0881 expref: 32 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.714518:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda82b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0881 expref: 32 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.714539:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:0.0:1787862385.714542:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862385.714545:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8c00, rc 0) 00000100:00100000:0.0:1787862385.714623:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d073c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11152:x1874709223395072:12345-192.168.202.9@tcp:101:bash.0 Request processed in 263us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862385.714631:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 193 00000100:00100000:0.0:1787862385.730839:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.731763:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223395200 00000100:00100000:3.0:1787862385.731780:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223395200 00000100:00100000:3.0:1787862385.731850:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1787862385.731863:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:11152:x1874709223395200:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1787862385.731890:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862385.731921:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0888 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862385.731957:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a909d6f, atime: 0x6a909d6d, ctime: 0x6a909d6f, blocks: 0xb 00010000:00010000:3.0:1787862385.731985:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1787862385.731990:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862385.732000:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.732022:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.732426:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862385.732515:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:11152:x1874709223395200:12345-192.168.202.9@tcp:101:bash.0 Request processed in 653us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862385.732538:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1787862385.746573:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862385.746744:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223395328 00000100:00100000:1.0:1787862385.746758:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223395328 00002000:00010000:1.0:1787862385.746823:0:6716:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787862385.746829:0:6716:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d858f00 with x1874709223395328 ext(0->18446744073709551615) 00002000:00010000:1.0:1787862385.746848:0:6716:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13d858f00. 00000100:00100000:1.0:1787862385.746895:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862385.746909:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2354:x1874709223395328:12345-192.168.202.9@tcp:10:bash.0 00002000:00010000:1.0:1787862385.747369:0:6716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787862385.747375:0:6716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787862383 -> 1787862386 00002000:00010000:1.0:1787862385.747378:0:6716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787862381 -> 1787862381 00002000:00010000:1.0:1787862385.747381:0:6716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787862383 -> 1787862386 00002000:00010000:1.0:1787862385.747383:0:6716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787862385.747476:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2354:x1874709223395328:12345-192.168.202.9@tcp:10:bash.0 Request processed in 567us (917us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787862385.747487:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00002000:00010000:1.0:1787862385.747492:0:6716:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787862385.747496:0:6716:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d858f00 with x1874709223395328 ext(0->18446744073709551615) 00002000:00010000:1.0:1787862385.747501:0:6716:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13d858f00. 00010000:00010000:2.0:1787862385.796438:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862385.895737:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862385.896297:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223395456 00000100:00100000:3.0:1787862385.896312:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223395456 00000100:00100000:3.0:1787862385.896394:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:3.0:1787862385.896407:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11633:x1874709223395456:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1787862385.896526:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.896549:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.896564:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.896581:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.896588:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.896594:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.897582:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.897598:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.897608:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862385.898014:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898031:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898056:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898065:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898072:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.898077:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898085:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898111:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862385.898114:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.898121:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898128:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda839 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898145:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898151:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898166:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898172:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.898175:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898181:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898192:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a103200800) 00010000:00010000:3.0:1787862385.898195:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.898197:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898203:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898223:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898229:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898234:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898240:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862385.898242:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898260:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898269:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:3.0:1787862385.898271:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862385.898274:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862385.898279:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862385.898402:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11633:x1874709223395456:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 1992us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862385.898413:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:2.0:1787862385.990212:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862385.990336:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223395712 00000100:00100000:0.0:1787862385.990348:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223395712 00000100:00100000:0.0:1787862385.990422:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 195 00000100:00100000:0.0:1787862385.990433:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+32:11636:x1874709223395712:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862385.990478:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862385.990515:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda84e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c088f expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.990613:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.990632:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.990647:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.990662:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.990680:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.990688:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991160:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991173:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991181:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862385.991193:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787862385.991329:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991338:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991345:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991351:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862385.991356:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991365:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991380:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:0.0:1787862385.991385:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862385.991391:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991397:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9400/0x391a6cd368cda855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991411:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991418:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991424:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991430:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862385.991438:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991445:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991453:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a116882800) 00010000:00010000:0.0:1787862385.991456:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862385.991459:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991465:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9200/0x391a6cd368cda85c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991511:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda84e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c088f expref: 35 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991524:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c088f expref: 34 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862385.991532:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:0.0:1787862385.991534:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787862385.991537:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8e00, rc 0) 00000100:00100000:0.0:1787862385.991608:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11636:x1874709223395712:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1177us (1412us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787862385.991617:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 195 00000100:00100000:0.0:1787862386.006820:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.007028:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223395840 00000100:00100000:1.0:1787862386.007086:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223395840 00000100:00100000:1.0:1787862386.007179:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:1.0:1787862386.007192:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11636:x1874709223395840:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1787862386.007320:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.007344:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 34 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.007355:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.007400:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 34 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.007417:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 34 pid: 5868 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862386.007435:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246461696:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862386.007560:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2bcc0 going to sleep for 11 seconds 00000100:00080000:2.0:1787862386.008683:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862386.013613:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246461696:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862386.013662:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862386.017566:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.017805:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223396096 00000100:00100000:3.0:1787862386.017820:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223396096 00000100:00100000:3.0:1787862386.017920:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:3.0:1787862386.017933:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:5595:x1874709223396096:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787862386.018446:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:5595:x1874709223396096:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 512us (895us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787862386.018457:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:2.0:1787862386.021416:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.021533:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223396224 00000100:00100000:3.0:1787862386.021546:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223396224 00010000:00010000:3.0:1787862386.021601:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 36 pid: 5868 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.021654:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:3.0:1787862386.021666:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:2353:x1874709223396224:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862386.021704:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862386.021713:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 36 pid: 5868 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.021730:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 36 pid: 5868 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.021769:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cda816 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c087a expref: 36 pid: 5868 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.021790:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:3.0:1787862386.021798:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.021809:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.021819:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.021859:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862386.021943:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:2353:x1874709223396224:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 278us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862386.021951:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00010000:00010000:1.0:1787862386.022391:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022401:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022441:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022462:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022469:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022476:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862386.022481:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022490:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022501:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:1.0:1787862386.022504:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862386.022510:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.022517:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862386.022587:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11636:x1874709223395840:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 15396us (15780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862386.022597:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:2.0:1787862386.029643:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.029848:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223396480 00000100:00100000:3.0:1787862386.029864:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223396480 00000100:00100000:3.0:1787862386.029945:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:3.0:1787862386.029959:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+34:11636:x1874709223396480:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862386.030427:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:11636:x1874709223396480:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 467us (795us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787862386.030437:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:0.0:1787862386.152565:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.152790:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223396736 00000100:00100000:3.0:1787862386.152803:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223396736 00000100:00100000:3.0:1787862386.152890:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 197 00000100:00100000:3.0:1787862386.152903:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+35:11648:x1874709223396736:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:3.0:1787862386.152938:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862386.152968:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0896 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153133:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153153:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153168:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153187:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153196:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153203:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153652:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153857:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.153914:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862386.153929:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787862386.154096:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154114:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154121:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154128:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.154133:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154143:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154158:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862386.154161:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.154167:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154174:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda87f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154189:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154205:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154211:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154217:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.154220:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154227:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154236:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a103200800) 00010000:00010000:3.0:1787862386.154238:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.154241:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154248:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154312:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0896 expref: 38 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154327:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0896 expref: 37 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.154335:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:3.0:1787862386.154337:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862386.154347:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d600, rc 0) 00000100:00100000:3.0:1787862386.154445:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11648:x1874709223396736:12345-192.168.202.9@tcp:101:cat.0 Request processed in 1544us (1895us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787862386.154456:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 197 00000100:00100000:0.0:1787862386.163521:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.163648:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223396992 00000100:00100000:3.0:1787862386.163663:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223396992 00000100:00100000:3.0:1787862386.163743:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:3.0:1787862386.163765:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11648:x1874709223396992:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:3.0:1787862386.164143:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:11648:x1874709223396992:12345-192.168.202.9@tcp:35:cat.0 Request processed in 381us (639us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787862386.164152:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:2.0:1787862386.205185:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.205392:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223397248 00000100:00100000:3.0:1787862386.205406:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223397248 00000100:00100000:3.0:1787862386.205497:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 198 00000100:00100000:3.0:1787862386.205510:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:11649:x1874709223397248:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:3.0:1787862386.205592:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787862386.205631:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cda88d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0896 expref: 38 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205662:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8e00/0x391a6cd368cda863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c088f expref: 37 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205694:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8c00/0x391a6cd368cda82b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0881 expref: 36 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205706:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a116882200) 00010000:00010000:3.0:1787862386.205720:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862386.205771:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205791:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205804:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205821:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205828:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.205835:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.206298:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.206308:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.206316:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862386.207152:0:9468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1787862386.207167:0:9468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437242126094ns, next at 438242121950ns, rc = 0 00010000:00010000:3.0:1787862386.207249:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207262:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207281:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207290:0:9468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207297:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207303:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207320:0:9468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862386.207349:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207356:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207363:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207370:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2dc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.207375:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207384:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207396:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a103200000) 00010000:00010000:3.0:1787862386.207400:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787862386.207412:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207420:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2dc00/0x391a6cd368cda8a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207444:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207451:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207458:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207463:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.207466:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207473:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207482:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862386.207485:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.207488:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.207494:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cda89b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862386.207505:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000000349e5b reply state 00000000b3b2241d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.207524:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862386.207642:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+37:11649:x1874709223397248:12345-192.168.202.9@tcp:36:rm.0 Request processed in 2130us (2468us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787862386.207652:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 198 00010000:00010000:0.0:1787862386.208334:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862386.208345:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.208355:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862386.208359:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.208367:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.208380:0:8521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89a103200000) 00010000:00010000:0.0:1787862386.208382:0:8521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787862386.208385:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.208391:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.208420:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862386.208422:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862386.208424:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862386.227857:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.227884:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.227893:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.227900:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2da00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.227906:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.227915:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.227938:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a103200800) 00010000:00010000:3.0:1787862386.227942:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.227948:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.227955:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cda8a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862386.273280:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.273390:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223397504 00000100:00100000:3.0:1787862386.273404:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223397504 00000100:00100000:3.0:1787862386.273521:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 199 00000100:00100000:3.0:1787862386.273533:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+36:11655:x1874709223397504:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1787862386.273567:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862386.273597:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda8b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c089d expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.273797:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.273817:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.273832:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.273849:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.273856:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.273862:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862386.274642:0:5870:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787862386.274861:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274875:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274886:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274945:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274953:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274961:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274967:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.274972:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274981:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.274996:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862386.275000:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.275007:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.275014:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862386.275032:0:5870:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000319e7f45 reply state 000000008e6790b4 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.275422:0:5870:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787862386.277271:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cda8b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 39 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.277308:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 38 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.277319:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:0.0:1787862386.277323:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862386.277327:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031600, rc 0) 00000100:00100000:0.0:1787862386.277463:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:11655:x1874709223397504:12345-192.168.202.9@tcp:101:bash.0 Request processed in 3930us (4198us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787862386.277474:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 199 00010000:00010000:3.0:1787862386.281502:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.281557:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.281566:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.281572:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.281578:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.281588:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.281611:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a103200800) 00010000:00010000:3.0:1787862386.281615:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.281621:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862386.281716:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.282244:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223397632 00000100:00100000:1.0:1787862386.282258:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223397632 00000100:00100000:1.0:1787862386.282359:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:1.0:1787862386.282371:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223397632:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862386.282398:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.282432:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08a4 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862386.282466:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862386.282505:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1787862386.282511:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862386.282524:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.282547:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.282562:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862386.282645:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223397632:12345-192.168.202.9@tcp:101:bash.0 Request processed in 275us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862386.282653:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00080000:2.0:1787862386.282785:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862386.283723:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862386.288146:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862386.288250:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223397760 00000100:00100000:0.0:1787862386.288262:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223397760 00000100:00100000:0.0:1787862386.288333:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:0.0:1787862386.288345:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:11655:x1874709223397760:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1787862386.288372:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862386.288398:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08ab expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.288443:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.288453:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862386.288458:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862386.288464:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.288520:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.288538:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862386.288555:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d3f12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1874709246461824:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862386.288709:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862386.292808:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d3f12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1874709246461824:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862386.292859:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.292890:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9200, rc 0) 00000100:00100000:0.0:1787862386.292981:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1066d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:11655:x1874709223397760:12345-192.168.202.9@tcp:101:bash.0 Request processed in 4637us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862386.292992:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:2.0:1787862386.294861:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.294994:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223397888 00000100:00100000:1.0:1787862386.295008:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223397888 00010000:00010000:1.0:1787862386.295105:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862386.295152:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1787862386.295163:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223397888:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862386.295191:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862386.295231:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.295276:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.295315:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d03890de/0x391a6cd368cda8da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08a4 expref: 7 pid: 6712 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.295339:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862386.295348:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862386.295361:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.295377:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.295442:0:5855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862386.295465:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5855:1874709246461952:192.168.202.9@tcp:105: 00000100:00100000:1.0:1787862386.295595:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862386.300710:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5855:1874709246461952:192.168.202.9@tcp:105: 00010000:00010000:1.0:1787862386.300757:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862386.300835:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2352:x1874709223397888:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 5672us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862386.300850:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:2.0:1787862386.312986:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.313090:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223398144 00000100:00100000:3.0:1787862386.313113:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223398144 00000100:00100000:3.0:1787862386.313192:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1787862386.313205:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+38:11655:x1874709223398144:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:3.0:1787862386.314212:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:11655:x1874709223398144:12345-192.168.202.9@tcp:35:bash.0 Request processed in 1000us (1235us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787862386.314894:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:0.0:1787862386.519965:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.522138:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223398272 00000100:00100000:3.0:1787862386.522184:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223398272 00000100:00100000:3.0:1787862386.522348:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:3.0:1787862386.522361:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+39:11671:x1874709223398272:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862386.522398:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862386.522430:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08b2 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.522550:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.522569:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.522585:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862386.522905:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787862386.522910:0:9468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862386.522942:0:9468:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.522976:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cda8e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08b2 expref: 41 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.523331:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08b2 expref: 40 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.523342:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862386.523345:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862386.523349:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031a00, rc 0) 00000100:00100000:3.0:1787862386.523657:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d3f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11671:x1874709223398272:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1297us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862386.523666:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:0.0:1787862386.538011:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.538239:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223398528 00000100:00100000:1.0:1787862386.538252:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223398528 00000100:00100000:1.0:1787862386.538320:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 201 00000100:00100000:1.0:1787862386.538331:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+40:11671:x1874709223398528:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862386.538362:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.538392:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda8f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08b9 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.538529:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda8fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.538546:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.538560:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862386.538574:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787862386.538765:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda8f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08b9 expref: 43 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.538789:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda8fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08b9 expref: 42 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.538799:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:1.0:1787862386.538803:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862386.538807:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8a00, rc 0) 00000100:00100000:1.0:1787862386.538895:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+42:11671:x1874709223398528:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 565us (909us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787862386.538926:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 201 00000100:00100000:2.0:1787862386.548881:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862386.548949:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.549137:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223398912 00000100:00100000:1.0:1787862386.549152:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223398912 00000100:00100000:1.0:1787862386.549240:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:1.0:1787862386.549254:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+42:11671:x1874709223398912:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862386.549292:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.549322:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda90b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08c0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.549504:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda912 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.549526:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.549540:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862386.549557:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787862386.549725:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda90b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c0 expref: 45 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.549749:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c0 expref: 44 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.549758:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:1.0:1787862386.549761:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862386.549765:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9a00, rc 0) 00000100:00100000:1.0:1787862386.549849:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:11671:x1874709223398912:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 598us (898us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787862386.549857:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:3.0:1787862386.550019:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223398656 00000100:00100000:3.0:1787862386.550026:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223398656 00000100:00100000:3.0:1787862386.550146:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1787862386.550155:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+44:2352:x1874709223398656:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862386.550168:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862386.550186:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda8fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08b9 expref: 44 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.550199:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:3.0:1787862386.550203:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862386.550229:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:2352:x1874709223398656:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 75us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862386.550237:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1787862386.557035:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.557251:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223399040 00000100:00100000:1.0:1787862386.557265:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223399040 00000100:00100000:1.0:1787862386.557343:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:1.0:1787862386.557355:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+6:2355:x1874709223399040:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:1.0:1787862386.557439:0:9223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.557465:0:9223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.557474:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862386.557480:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862386.557485:0:9223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.557536:0:9223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.557553:0:9223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 6 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862386.557570:0:9223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9223:1874709246462080:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862386.557699:0:9223:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862386.562933:0:9223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0730c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9223:1874709246462080:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862386.562981:0:9223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.564512:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.564585:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223399168 00000100:00100000:1.0:1787862386.564596:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223399168 00002000:00100000:1.0:1787862386.564673:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89a13d85b0c0 x1874709223399168/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:502/0 lens 504/0 e 0 to 0 dl 1787862397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862386.564687:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d85b0c0 with x1874709223399168 ext(0->8) 00010000:00010000:1.0:1787862386.564713:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 7 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.564732:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 7 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862386.564741:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a13d85b0c0 00000100:00100000:1.0:1787862386.564787:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:1.0:1787862386.564800:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223399168:12345-192.168.202.9@tcp:4:lfs.0 00000100:00100000:1.0:1787862386.565901:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2353:x1874709223399168:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 1094us (1390us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787862386.565913:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00002000:00100000:1.0:1787862386.565923:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89a13d85b0c0 x1874709223399168/t4294967308(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:502/0 lens 504/448 e 0 to 0 dl 1787862397 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862386.565933:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13d85b0c0 with x1874709223399168 ext(0->8) 00010000:00010000:1.0:1787862386.565942:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 9 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.565967:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 9 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862386.565977:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a13d85b0c0 00000100:00100000:0.0:1787862386.574188:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.574362:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223399296 00000100:00100000:3.0:1787862386.574376:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223399296 00010000:00010000:3.0:1787862386.574431:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 9 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.574475:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:3.0:1787862386.574498:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2353:x1874709223399296:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862386.574519:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787862386.574547:0:5853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787862386.574570:0:5853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787862386 00002000:00010000:3.0:1787862386.574573:0:5853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787862386 00002000:00010000:3.0:1787862386.574575:0:5853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787862386 00010000:00010000:3.0:1787862386.574583:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 9 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.574600:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 9 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.574633:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000506908c0/0x391a6cd368cda8e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ab expref: 9 pid: 6709 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.574658:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862386.574663:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862386.574671:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.574683:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.574726:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862386.574809:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223399296:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 323us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862386.574818:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00010000:00010000:2.0:1787862386.574847:0:9223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574859:0:9223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574890:0:9223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574900:0:9223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574909:0:9223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574930:0:9223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862386.574935:0:9223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574945:0:9223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574957:0:9223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.574964:0:9223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cda920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862386.575031:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2355:x1874709223399040:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 17678us (18012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862386.575072:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:2.0:1787862386.579007:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862386.579182:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223399552 00000100:00100000:0.0:1787862386.579197:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223399552 00000100:00100000:0.0:1787862386.579276:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:0.0:1787862386.579288:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+43:11671:x1874709223399552:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:0.0:1787862386.579377:0:5872:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c0 expref: 43 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862386.579781:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787862386.579830:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787862386.580383:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787862386.580448:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.580469:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 47 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.580495:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.580540:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 47 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862386.580559:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 47 pid: 5870 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862386.580576:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5872:1874709246462208:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862386.580691:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862386.585559:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862386.585717:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5872:1874709246462208:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862386.585774:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.586148:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223399680 00000100:00100000:3.0:1787862386.586158:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223399680 00010000:00010000:3.0:1787862386.586207:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 48 pid: 5870 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862386.586286:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:3.0:1787862386.586297:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+48:2352:x1874709223399680:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862386.586318:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862386.586326:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 48 pid: 5870 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.586339:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 48 pid: 5870 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.586367:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cda8cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c089d expref: 48 pid: 5870 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.586388:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:3.0:1787862386.586394:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.586416:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.586426:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.586456:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862386.586531:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+47:2352:x1874709223399680:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 234us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862386.586539:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00010000:00010000:2.0:1787862386.587606:0:5872:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.587620:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862386.587837:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787862386.588152:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787862386.588575:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5872:1874709246462336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787862386.588661:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862386.589661:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1192976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862386.590030:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246462336 00000100:00100000:3.0:1787862386.590077:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246462336 00000100:00080000:0.0:1787862386.590427:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862386.590571:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787862386.590585:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5872:x1874709246462336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787862386.590759:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a120580780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5872:x1874709246462336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 173us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862386.590770:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862386.590856:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5872:1874709246462336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787862386.592405:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787862386.592546:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5872:1874709246462464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787862386.592636:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862386.593494:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11c07a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787862386.593584:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246462464 00000100:00100000:1.0:1787862386.593594:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246462464 00000100:00100000:1.0:1787862386.593651:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787862386.593663:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5872:x1874709246462464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787862386.594257:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5872:x1874709246462464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 593us (1618us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787862386.594268:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862386.594454:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5872:1874709246462464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787862386.594625:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787862386.594681:0:5872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.594695:0:5872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.594703:0:5872:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.594710:0:5872:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862386.594715:0:5872:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.594724:0:5872:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.594893:0:5872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:2.0:1787862386.594896:0:5872:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787862386.594903:0:5872:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.594909:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9e00/0x391a6cd368cda927 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5872 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862386.600368:0:5872:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787862386.600905:0:5872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787862386.600922:0:5872:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437635880718ns, next at 438635876334ns, rc = 0 00000001:00080000:2.0:1787862386.600934:0:5872:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787862386.601007:0:5872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a103200300) 00010000:00010000:2.0:1787862386.601012:0:5872:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787862386.601026:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda912 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c0 expref: 51 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862386.601348:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:11671:x1874709223399552:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 22061us (22354us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787862386.601360:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00000020:00080000:2.0:1787862386.601367:0:5872:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787862386.605473:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.605628:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223399808 00000100:00100000:1.0:1787862386.605642:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223399808 00000100:00100000:1.0:1787862386.605714:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 203 00000100:00100000:1.0:1787862386.605725:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+50:11671:x1874709223399808:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862386.605774:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.605805:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda92e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08c7 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.605889:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda92e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c7 expref: 51 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.605906:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda92e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c7 expref: 51 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.605956:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862386.605960:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862386.605965:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:1.0:1787862386.606073:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:11671:x1874709223399808:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 348us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862386.606082:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 203 00000100:00100000:0.0:1787862386.610972:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862386.611404:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223400064 00000100:00100000:3.0:1787862386.611419:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223400064 00000100:00100000:3.0:1787862386.611500:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:3.0:1787862386.611513:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+51:11671:x1874709223400064:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1787862386.612006:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11671:x1874709223400064:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 494us (1046us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787862386.612017:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:2.0:1787862386.736180:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.737226:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223400192 00000100:00100000:1.0:1787862386.737244:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223400192 00000100:00100000:1.0:1787862386.737334:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:1.0:1787862386.737347:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11681:x1874709223400192:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:1.0:1787862386.737454:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.737476:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.737607:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.737625:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.737633:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.737640:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.738352:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.738382:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.738391:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862386.738449:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.738464:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.738472:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739313:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739330:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862386.739337:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739347:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739365:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862386.739368:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862386.739374:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739381:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda935 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739415:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739421:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739427:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739433:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862386.739436:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739443:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739451:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a104fc5500) 00010000:00010000:1.0:1787862386.739454:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862386.739457:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739462:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda93c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739656:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739675:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739682:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739695:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862386.739698:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739705:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739715:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862386.739718:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862386.739721:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.739727:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862386.740598:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11681:x1874709223400192:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 3246us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862386.740613:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:0.0:1787862386.805445:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.805572:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223400448 00000100:00100000:1.0:1787862386.805585:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223400448 00000100:00100000:1.0:1787862386.805657:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 205 00000100:00100000:1.0:1787862386.805682:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+52:11684:x1874709223400448:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862386.805716:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.805765:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda94a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08ce expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.805866:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.805906:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.805922:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.805941:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.805949:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.805956:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806181:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda95f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806190:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806198:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862386.806209:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787862386.806336:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806345:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806353:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806367:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862386.806373:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806382:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806397:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862386.806401:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862386.806407:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806414:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806432:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806438:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806444:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806449:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862386.806452:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806459:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806480:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a104fc5500) 00010000:00010000:1.0:1787862386.806483:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862386.806486:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806492:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806542:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda94a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ce expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806559:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ce expref: 54 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.806567:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862386.806569:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862386.806572:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9a00, rc 0) 00000100:00100000:1.0:1787862386.806661:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:11684:x1874709223400448:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 992us (1232us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787862386.806670:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 205 00000100:00100000:0.0:1787862386.817123:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862386.817285:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223400576 00000100:00100000:2.0:1787862386.817299:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223400576 00000100:00100000:2.0:1787862386.817373:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:2.0:1787862386.817386:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:11684:x1874709223400576:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:2.0:1787862386.817484:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817525:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817539:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817575:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817583:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817591:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817598:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79ec00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862386.817604:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817612:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817626:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862386.817629:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862386.817636:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.817643:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cda96d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862386.818107:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:11684:x1874709223400576:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 711us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862386.818125:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 206 00010000:00010000:0.0:1787862386.824304:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862386.829511:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862386.832063:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223400832 00000100:00100000:2.0:1787862386.832086:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223400832 00000100:00100000:2.0:1787862386.832297:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:2.0:1787862386.832311:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+54:11684:x1874709223400832:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862386.832682:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:11684:x1874709223400832:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 372us (3184us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787862386.832708:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:0.0:1787862386.948522:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.948645:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223401088 00000100:00100000:1.0:1787862386.948658:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223401088 00000100:00100000:1.0:1787862386.948747:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 207 00000100:00100000:1.0:1787862386.948768:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+55:11694:x1874709223401088:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862386.948803:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.948807:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787862386.948844:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031a00/0x391a6cd368cda8ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08b2 expref: 55 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.948887:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862386.948893:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862386.948911:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda974 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08d5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.949118:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda97b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.949137:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.949149:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862386.949162:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787862386.949326:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda974 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08d5 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.949342:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08d5 expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.949350:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862386.949353:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862386.949356:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8400, rc 0) 00000100:00100000:1.0:1787862386.949434:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:11694:x1874709223401088:12345-192.168.202.9@tcp:101:bash.0 Request processed in 668us (929us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787862386.949443:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 207 00000100:00100000:1.0:1787862386.955343:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862386.955735:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223401344 00000100:00100000:2.0:1787862386.955757:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223401344 00000100:00100000:2.0:1787862386.955839:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:2.0:1787862386.955851:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+56:11694:x1874709223401344:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:2.0:1787862386.955932:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787862386.955969:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda97b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08d5 expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.955996:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda95f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ce expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.956008:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862386.956014:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862386.956527:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.956545:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862386.956571:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862386.956640:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787862386.956669:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006beb729a reply state 00000000f37e08d7 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862386.956680:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862386.957504:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11694:x1874709223401344:12345-192.168.202.9@tcp:36:bash.0 Request processed in 1649us (2171us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787862386.957515:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 208 00000020:00080000:2.0:1787862386.957522:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787862386.964070:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862386.964190:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223401472 00000100:00100000:1.0:1787862386.964204:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223401472 00000100:00100000:1.0:1787862386.964290:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 209 00000100:00100000:1.0:1787862386.964303:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11694:x1874709223401472:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1787862386.964338:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862386.964365:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda990 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08dc expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.964474:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.964501:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.964511:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.964532:0:5868:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.964546:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968350:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968378:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968387:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968393:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862386.968399:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968407:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968443:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862386.968472:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862386.968476:0:3314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968563:0:3314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968572:0:3314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968664:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862386.968672:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cda989 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.969686:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.969700:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862386.969875:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787862386.969881:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862386.969926:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.969976:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda990 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.969999:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862386.970008:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862386.970012:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862386.970016:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9400, rc 0) 00000100:00100000:1.0:1787862386.975518:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11694:x1874709223401472:12345-192.168.202.9@tcp:101:bash.0 Request processed in 11195us (11465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862386.975536:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 209 00000100:00100000:2.0:1787862386.986311:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862386.986516:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223401728 00000100:00100000:0.0:1787862386.986531:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223401728 00000100:00100000:0.0:1787862386.986603:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:0.0:1787862386.986616:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+57:11694:x1874709223401728:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:0.0:1787862386.986961:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11694:x1874709223401728:12345-192.168.202.9@tcp:35:bash.0 Request processed in 345us (663us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787862386.986986:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:0.0:1787862387.034021:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862387.034133:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862387.034165:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862387.034272:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223402112 00000100:00100000:2.0:1787862387.034286:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223402112 00000100:00100000:2.0:1787862387.034385:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 183 00000100:00100000:2.0:1787862387.034397:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223402112:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862387.034502:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2355:x1874709223402112:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862387.034510:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 183 00000100:00100000:1.0:1787862387.034886:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223401856 00000100:00100000:1.0:1787862387.034893:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223401856 00000100:00100000:1.0:1787862387.034940:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 306 00000100:00100000:1.0:1787862387.034948:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223401856:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862387.034985:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2355:x1874709223401856:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862387.034993:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 306 00000100:00080000:0.0:1787862387.035086:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862387.035693:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223401984 00000100:00100000:3.0:1787862387.035700:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223401984 00000100:00080000:0.0:1787862387.035836:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862387.041419:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:0.0:1787862387.041457:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2355:x1874709223401984:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862387.041607:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2355:x1874709223401984:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 169us (7601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862387.041617:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1787862387.132619:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862387.133072:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223402240 00000100:00100000:1.0:1787862387.133087:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223402240 00000100:00100000:1.0:1787862387.133171:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:1.0:1787862387.133183:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+58:11700:x1874709223402240:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862387.133216:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862387.133260:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda99e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08e3 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.133347:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda9a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.133364:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.133378:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862387.133457:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787862387.133462:0:5870:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862387.133502:0:5870:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.133534:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda99e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08e3 expref: 60 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.133556:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08e3 expref: 59 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.133566:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862387.133570:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862387.133575:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8e00, rc 0) 00000100:00100000:1.0:1787862387.133662:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11700:x1874709223402240:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 480us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862387.133671:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:1.0:1787862387.141402:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862387.143617:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223402368 00000100:00100000:0.0:1787862387.143638:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223402368 00000100:00100000:1.0:1787862387.145011:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 211 00000100:00100000:1.0:1787862387.145029:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11700:x1874709223402368:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862387.145110:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862387.145139:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda9ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08ea expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145229:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145249:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145263:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145282:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145289:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145296:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145441:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145452:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145461:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862387.145539:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787862387.145545:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862387.145567:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145582:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145591:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145597:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145604:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145610:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862387.145615:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145623:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145638:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862387.145641:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862387.145646:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145652:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cda9b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145706:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145713:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145720:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145724:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862387.145727:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145734:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145954:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a104fc5500) 00010000:00010000:1.0:1787862387.145957:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862387.145961:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.145967:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cda9ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.146007:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cda9ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 61 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.146022:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 60 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.146107:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862387.146110:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862387.146113:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8400, rc 0) 00000100:00100000:1.0:1787862387.146208:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11700:x1874709223402368:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1182us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862387.146217:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 211 00000100:00100000:0.0:1787862387.152197:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862387.153397:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862387.153593:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223402624 00000100:00100000:1.0:1787862387.153606:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223402624 00000100:00100000:1.0:1787862387.153889:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:1.0:1787862387.153902:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11700:x1874709223402624:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862387.153932:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862387.153960:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda9c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08f1 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862387.156375:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223402752 00000100:00100000:3.0:1787862387.156393:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223402752 00010000:00010000:1.0:1787862387.156997:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.157028:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.157037:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.157064:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.157126:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.157160:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 62 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862387.157178:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246462592:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862387.157318:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.157328:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 62 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862387.157338:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d071a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246462720:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862387.157363:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e2b780 going to sleep for 11 seconds 00010000:00010000:3.0:1787862387.157653:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 62 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862387.157718:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:3.0:1787862387.157734:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+62:2354:x1874709223402752:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787862387.161178:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862387.161243:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223402880 00000100:00100000:0.0:1787862387.161254:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223402880 00010000:00010000:0.0:1787862387.161308:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 63 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862387.161350:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:0.0:1787862387.161361:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+63:2353:x1874709223402880:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862387.161381:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862387.161389:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 63 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862387.161814:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862387.161824:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 63 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862387.161840:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 63 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862387.161884:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862387.161889:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862387.161899:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862387.161906:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862387.161979:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+63:2354:x1874709223402752:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4250us (8588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862387.161989:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00010000:00010000:2.0:1787862387.162283:0:5870:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.9@tcp) returned -22 from blocking AST (req@00000000bea0d19f x1874709246462592) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 62 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.162298:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cda9c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ea expref: 62 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862387.162327:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246462592:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862387.162346:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d071a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246462720:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862387.162372:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862387.162377:0:5870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.162384:0:5870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.162393:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862387.162931:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 61 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862387.162951:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9400/0x391a6cd368cda997 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08dc expref: 61 pid: 5868 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862387.162964:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862387.162968:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862387.162976:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862387.162984:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862387.163006:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862387.163083:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:2353:x1874709223402880:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1723us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862387.163102:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00010000:00010000:2.0:1787862387.166227:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.166251:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862387.166285:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787862387.166531:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cda9c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 61 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.166557:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 60 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.166567:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862387.166570:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862387.166592:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a142160400, rc 0) 00000100:00100000:2.0:1787862387.166697:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11700:x1874709223402624:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 12796us (14513us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787862387.166709:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:0.0:1787862387.170616:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862387.170875:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223403136 00000100:00100000:1.0:1787862387.170889:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223403136 00000100:00100000:1.0:1787862387.170968:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862387.170979:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11700:x1874709223403136:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:1.0:1787862387.170997:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862387.171031:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cda92e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08c7 expref: 60 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862387.171088:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862387.171103:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862387.171169:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11700:x1874709223403136:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 191us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862387.171177:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862387.175584:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862387.175699:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223403264 00000100:00100000:2.0:1787862387.175713:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223403264 00000100:00100000:2.0:1787862387.175793:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:2.0:1787862387.175805:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d070780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11700:x1874709223403264:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:2.0:1787862387.175968:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.175989:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.176003:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862387.176323:0:9468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787862387.176437:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d070780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11700:x1874709223403264:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 632us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862387.176447:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:3.0:1787862387.181310:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862387.183233:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223403392 00000100:00100000:2.0:1787862387.183253:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223403392 00000100:00100000:2.0:1787862387.183362:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:2.0:1787862387.183376:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d858780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+59:11700:x1874709223403392:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862387.183405:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862387.183438:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08f8 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.183557:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.183570:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.183594:0:5869:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.183609:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.183625:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862387.183629:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862387.183632:0:5869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862387.183641:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f600, rc 0) 00000100:00100000:2.0:1787862387.184296:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d858780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11700:x1874709223403392:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 918us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862387.184306:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:2.0:1787862387.718279:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246462848:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.718389:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862387.718484:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cba8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246463360:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.718546:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862387.718583:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862387.718598:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246463232:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.718630:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862387.718659:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246462976:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.718687:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862387.718705:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cbab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246463488:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.718728:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862387.719663:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862387.719677:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246463104:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.719723:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862387.720015:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246463232 00000100:00100000:0.0:1787862387.720025:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246463232 00000100:00100000:0.0:1787862387.720109:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246463488 00000100:00100000:0.0:1787862387.720112:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246463488 00000100:00100000:0.0:1787862387.720150:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787862387.720171:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246463232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862387.720247:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246463232:12345-0@lo:400:kworker.0 Request processed in 88us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862387.720270:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787862387.720290:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787862387.720297:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246463488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862387.720331:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246463488:12345-0@lo:400:kworker.0 Request processed in 35us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862387.720337:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1787862387.720353:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862387.720395:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246463232:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.721518:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cbab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862387.723017:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246462848 00000100:00100000:1.0:1787862387.723030:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246462848 00000100:00100000:1.0:1787862387.723156:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787862387.723168:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246462848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862387.723294:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246462848:12345-0@lo:400:kworker.0 Request processed in 128us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862387.723302:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787862387.728100:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d071a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246462848:0@lo:400:kworker.0 00000100:00100000:3.0:1787862387.732671:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246463360 00000100:00100000:3.0:1787862387.732694:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246463360 00000100:00100000:3.0:1787862387.733268:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246462976 00000100:00100000:3.0:1787862387.733275:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246462976 00000100:00100000:3.0:1787862387.733290:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246463104 00000100:00100000:3.0:1787862387.733294:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246463104 00000100:00100000:3.0:1787862387.733320:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787862387.733331:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246463360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.733625:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cba8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246463360:0@lo:400:kworker.0 00000100:00100000:2.0:1787862387.733669:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787862387.733677:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246462976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862387.733722:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246463360:12345-0@lo:400:kworker.0 Request processed in 392us (15175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862387.733731:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787862387.733760:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787862387.733767:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246463104:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787862387.734094:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862387.741010:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246462976:12345-0@lo:400:kworker.0 Request processed in 7317us (22305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862387.741031:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787862387.741911:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246462976:0@lo:400:kworker.0 00000100:00100000:3.0:1787862387.742154:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246463104:12345-0@lo:400:kworker.0 Request processed in 8384us (22427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862387.742187:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787862387.742277:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a00838a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246463104:0@lo:400:kworker.0 00010000:00010000:2.0:1787862387.844362:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862388.100695:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862388.100710:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862388.100760:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787862388.100769:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862388.100936:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cba9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246463616:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862388.101119:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862388.105828:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.106293:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223403520 00000100:00100000:0.0:1787862388.106306:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223403520 00000100:00100000:0.0:1787862388.106427:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 215 00000100:00100000:0.0:1787862388.106439:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223403520:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787862388.106494:0:5868:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787862388.106626:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223403520:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 189us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862388.106635:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 215 00000100:00080000:2.0:1787862388.106743:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862388.107336:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cba9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246463616:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862388.114160:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.114420:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223403648 00000100:00100000:2.0:1787862388.114435:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223403648 00000100:00100000:2.0:1787862388.114529:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:2.0:1787862388.114541:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11701:x1874709223403648:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787862388.114649:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.114961:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115072:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115106:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115115:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115122:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115153:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115161:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115168:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862388.115223:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787862388.115229:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862388.115245:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115259:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115279:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115287:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115294:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862388.115300:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115309:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115325:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:2.0:1787862388.115328:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862388.115335:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115342:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cda9eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115362:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115369:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115376:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115382:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862388.115391:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115399:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115408:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff89a1205e1600) 00010000:00010000:2.0:1787862388.115411:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862388.115414:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115421:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cda9f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115439:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115446:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115452:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115457:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862388.115460:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115466:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115474:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862388.115476:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862388.115486:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.115493:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cda9f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862388.115628:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11701:x1874709223403648:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 1084us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.115639:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:2.0:1787862388.125499:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.125604:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223403904 00000100:00100000:0.0:1787862388.125618:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223403904 00000100:00100000:0.0:1787862388.125706:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 217 00000100:00100000:0.0:1787862388.125719:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+60:11701:x1874709223403904:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862388.125758:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862388.125804:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaa00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c08ff expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.125936:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.125956:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.125971:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862388.125984:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787862388.134120:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134146:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134155:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134162:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862388.134167:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134176:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134198:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862388.134202:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787862388.134208:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134235:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e8800/0x391a6cd368cdaa07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134326:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaa00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ff expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134339:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:0.0:1787862388.134342:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862388.134346:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaa00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08ff expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.134356:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9c00, rc 0) 00000100:00100000:0.0:1787862388.134459:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223403904:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 8740us (8973us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787862388.137680:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 217 00000100:00100000:3.0:1787862388.140175:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.141183:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223404032 00000100:00100000:0.0:1787862388.141200:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223404032 00000100:00100000:0.0:1787862388.141285:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:0.0:1787862388.141296:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223404032:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787862388.141350:0:9468:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787862388.141916:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223404032:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 617us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862388.141927:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:1.0:1787862388.152654:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.152923:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223404288 00000100:00100000:3.0:1787862388.152939:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223404288 00000100:00100000:3.0:1787862388.153094:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 219 00000100:00100000:3.0:1787862388.153107:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223404288:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862388.153136:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862388.153139:0:5870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787862388.153182:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cda9a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08e3 expref: 61 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.153207:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862388.153213:0:5870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862388.153232:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0906 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862388.154303:0:5870:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787862388.156393:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaa1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.156422:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaa1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.156438:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaa1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.158006:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0906 expref: 63 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.158100:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaa1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0906 expref: 62 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.158111:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a103200600) 00010000:00010000:3.0:1787862388.158115:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862388.158119:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030e00, rc 0) 00000100:00100000:3.0:1787862388.158212:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+62:11701:x1874709223404288:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 5108us (5574us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787862388.158225:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 219 00000100:00100000:1.0:1787862388.165900:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.170920:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223404544 00000100:00100000:2.0:1787862388.170941:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223404544 00000100:00100000:2.0:1787862388.171931:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:2.0:1787862388.171951:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cba8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+62:11701:x1874709223404544:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862388.172077:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862388.172128:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaa1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0906 expref: 62 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172155:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a103200600) 00010000:00010000:2.0:1787862388.172173:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862388.172204:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172223:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172234:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172483:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172526:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172542:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172661:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172669:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172677:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172683:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862388.172688:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172696:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172710:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:2.0:1787862388.172714:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862388.172719:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172726:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdaa2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172754:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172766:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172772:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172788:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79e200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862388.172792:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172798:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172806:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6c352767 (ffff89a1205e1600) 00010000:00010000:2.0:1787862388.172809:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862388.172812:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.172818:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdaa31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6c352767 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862388.175248:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cba8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223404544:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 3291us (9350us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862388.175263:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:1.0:1787862388.180291:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.181214:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223404672 00000100:00100000:2.0:1787862388.181232:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223404672 00000100:00100000:2.0:1787862388.181313:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 221 00000100:00100000:2.0:1787862388.181325:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+61:11701:x1874709223404672:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862388.181347:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862388.181392:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c090d expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.181445:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.181458:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.181470:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.181571:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 63 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.181595:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.181604:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:2.0:1787862388.181607:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787862388.181611:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e800, rc 0) 00000100:00100000:2.0:1787862388.181680:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+62:11701:x1874709223404672:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 357us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.181688:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 221 00000100:00100000:0.0:1787862388.189484:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.189891:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223404928 00000100:00100000:3.0:1787862388.189903:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223404928 00000100:00100000:3.0:1787862388.189979:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:3.0:1787862388.189989:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+62:11701:x1874709223404928:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862388.190118:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.190139:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.190153:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862388.190415:0:9468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1787862388.190437:0:9468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439225385501ns, next at 440225381804ns, rc = 0 00000004:00010000:3.0:1787862388.190529:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009cba4d44 reply state 000000000025c860 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.190558:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862388.190672:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+64:11701:x1874709223404928:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 683us (1199us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787862388.190680:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 222 00010000:00010000:3.0:1787862388.193656:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.193675:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.193683:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.193689:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862388.193694:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.193702:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.193720:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:3.0:1787862388.193723:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787862388.193738:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.193745:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.199118:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.199221:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223405056 00000100:00100000:2.0:1787862388.199232:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223405056 00000100:00100000:2.0:1787862388.199300:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 223 00000100:00100000:2.0:1787862388.199311:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+63:11701:x1874709223405056:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862388.199339:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862388.199382:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0914 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.199450:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 64 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.199466:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 64 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.199487:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:2.0:1787862388.199490:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862388.199494:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e000, rc 0) 00000100:00100000:2.0:1787862388.199556:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+64:11701:x1874709223405056:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 246us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.199563:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 223 00000100:00100000:1.0:1787862388.203552:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.203658:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223405184 00000100:00100000:0.0:1787862388.203684:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223405184 00000100:00100000:0.0:1787862388.203762:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:0.0:1787862388.203772:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223405184:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787862388.204167:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2352:x1874709223405184:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 395us (624us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787862388.204176:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:0.0:1787862388.210003:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.210137:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223405440 00000100:00100000:3.0:1787862388.210148:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223405440 00000100:00100000:3.0:1787862388.210234:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:3.0:1787862388.210245:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+64:11701:x1874709223405440:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787862388.210506:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+65:11701:x1874709223405440:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 261us (512us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787862388.210514:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:1.0:1787862388.214565:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.214774:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223405696 00000100:00100000:3.0:1787862388.215094:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223405696 00000100:00100000:3.0:1787862388.215158:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 224 00000100:00100000:3.0:1787862388.215167:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+65:11701:x1874709223405696:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862388.215277:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+65:11701:x1874709223405696:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 111us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.215285:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 224 00000100:00100000:0.0:1787862388.228517:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862388.228540:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246463744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862388.228615:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862388.231158:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246463744 00000100:00100000:1.0:1787862388.231172:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246463744 00000100:00100000:1.0:1787862388.231249:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787862388.231259:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246463744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862388.231300:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862388.231389:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c4c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3329:x1874709246463744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862388.231410:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787862388.231502:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.231688:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223405824 00000100:00100000:3.0:1787862388.231693:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223405824 00000100:00100000:3.0:1787862388.231740:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 225 00000100:00100000:3.0:1787862388.231748:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+65:11701:x1874709223405824:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862388.231762:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862388.231796:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c091b expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.231862:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaa5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.231877:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.231889:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862388.232201:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862388.232222:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.232253:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c091b expref: 67 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.232272:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaa5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c091b expref: 66 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.232281:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:3.0:1787862388.232284:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787862388.232288:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030c00, rc 0) 00000100:00100000:3.0:1787862388.232336:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+66:11701:x1874709223405824:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 589us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.232343:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 225 00000100:00100000:0.0:1787862388.233119:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246463744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862388.243120:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.243354:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223405952 00000100:00100000:2.0:1787862388.243366:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223405952 00000100:00100000:2.0:1787862388.243430:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:2.0:1787862388.243441:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+10:2353:x1874709223405952:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862388.243473:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862388.243500:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0922 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862388.243527:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909d74, blocks: 0x1 00010000:00010000:2.0:1787862388.243552:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1787862388.243557:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862388.243567:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.243627:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.243641:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e200, rc 0) 00000100:00100000:2.0:1787862388.243704:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:2353:x1874709223405952:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 264us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.243711:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:1.0:1787862388.261570:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.262426:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406208 00000100:00100000:3.0:1787862388.262447:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406208 00000100:00100000:3.0:1787862388.262524:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 226 00000100:00100000:3.0:1787862388.262534:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+66:11701:x1874709223406208:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862388.262652:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+66:11701:x1874709223406208:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 119us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.262659:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 226 00000100:00100000:1.0:1787862388.278682:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.278811:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406336 00000100:00100000:0.0:1787862388.278821:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406336 00000100:00100000:0.0:1787862388.278885:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:0.0:1787862388.278897:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:11701:x1874709223406336:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862388.278918:0:9223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862388.278938:0:9223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0929 expref: -99 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.278975:0:9223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.278986:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862388.278990:0:9223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862388.278996:0:9223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 12 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.279113:0:9223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.279129:0:9223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 12 pid: 6711 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.279143:0:9223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246463872:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862388.279240:0:9223:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a107ee56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862388.285265:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.285518:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406464 00000100:00100000:3.0:1787862388.285529:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406464 00010000:00010000:3.0:1787862388.285577:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 13 pid: 6711 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.285637:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:3.0:1787862388.285648:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2352:x1874709223406464:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862388.285694:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862388.285723:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 13 pid: 6711 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.285738:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 13 pid: 6711 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.285765:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862388.285769:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862388.285791:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 13 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.285802:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 13 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.285838:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 13 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.285852:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5853:1874709246464000:192.168.202.9@tcp:105: 00000100:00100000:3.0:1787862388.285929:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e300 going to sleep for 11 seconds 00010000:00010000:2.0:1787862388.286142:0:9223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958949bb/0x391a6cd368cdaa62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0922 expref: 13 pid: 6711 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862388.286158:0:9223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9223:1874709246463872:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862388.286185:0:9223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 12 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.286196:0:9223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9e00, rc 0) 00000100:00100000:2.0:1787862388.286231:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:11701:x1874709223406336:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 7336us (7570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.286240:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:3.0:1787862388.295339:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5853:1874709246464000:192.168.202.9@tcp:105: 00010000:00010000:3.0:1787862388.295383:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862388.295453:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:2352:x1874709223406464:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 9806us (10199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.295469:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:1.0:1787862388.297983:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.298191:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406592 00000100:00100000:0.0:1787862388.298200:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406592 00002000:00100000:0.0:1787862388.298263:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff89a13cb892c0 x1874709223406592/t0(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:504/0 lens 504/0 e 0 to 0 dl 1787862399 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862388.298275:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13cb892c0 with x1874709223406592 ext(0->12) 00002000:00010000:0.0:1787862388.298283:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13cb892c0 00000100:00100000:0.0:1787862388.298324:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1787862388.298335:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+11:2353:x1874709223406592:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787862388.298923:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2353:x1874709223406592:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 588us (950us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787862388.298934:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00002000:00100000:0.0:1787862388.298942:0:6717:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff89a13cb892c0 x1874709223406592/t4294967320(0) o4->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:504/0 lens 504/448 e 0 to 0 dl 1787862399 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862388.298949:0:6717:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13cb892c0 with x1874709223406592 ext(0->12) 00002000:00010000:0.0:1787862388.298959:0:6717:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13cb892c0 00000100:00100000:0.0:1787862388.305316:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.305975:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406720 00000100:00100000:2.0:1787862388.305987:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406720 00000100:00100000:2.0:1787862388.306093:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 227 00000100:00100000:2.0:1787862388.306105:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+66:11701:x1874709223406720:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787862388.440240:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:2.0:1787862388.440324:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787862388.440354:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a1192979c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787862388.440360:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a110330500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a1192976c0 00000020:00080000:2.0:1787862388.440364:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a110330f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a13c46ec00 00000001:00080000:2.0:1787862388.440391:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787862388.440399:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787862388.440437:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787862388.440463:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a13ce36900 refcount 2 committed 0 result 0 batchid 6 00000100:00100000:0.0:1787862388.440518:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246464128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787862388.440596:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787862388.440704:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787862388.441602:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a111f16800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a13ce36e40 00000020:00080000:2.0:1787862388.441606:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a111f16f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a13cbef000 00000100:00100000:2.0:1787862388.441853:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246464256:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787862388.441888:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1787862388.441913:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862388.441972:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246464128 00000100:00100000:2.0:1787862388.441980:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246464128 00000100:00100000:2.0:1787862388.442033:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246464256 00000020:00080000:3.0:1787862388.442139:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787862388.442267:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246464256 00000100:00100000:2.0:1787862388.442295:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787862388.442304:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3327:x1874709246464128:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787862388.442332:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00002000:00080000:2.0:1787862388.442337:0:6709:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000100:00100000:3.0:1787862388.442344:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3328:x1874709246464256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787862388.442361:0:12084:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787862388.442374:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a909d72, atime: 0x6a909d72, ctime: 0x6a909d72, blocks: 0x1 00010000:00010000:3.0:1787862388.442382:0:12084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.442384:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.442418:0:12084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.442428:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787862388.442432:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862388.442437:0:12084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.442471:0:12084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.442486:0:12084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 12 pid: 6711 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.442517:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12084:1874709246464512:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862388.442589:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102a7e300 going to sleep for 11 seconds 00010000:00010000:2.0:1787862388.442676:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1787862388.442681:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862388.442687:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.442712:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.442723:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.442731:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.442757:0:6709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787862388.443145:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11701:x1874709223406720:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 137038us (137838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862388.443158:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 227 00010000:00010000:3.0:1787862388.443229:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862388.443237:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.443245:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fc00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862388.443250:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.443259:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.443277:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.443285:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038cb18f1/0x391a6cd368cdaa70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.443305:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862388.443307:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862388.443309:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862388.445429:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862388.445453:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246464384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787862388.445550:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787862388.447237:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862388.447746:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3327:x1874709246464128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5438us (7145us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787862388.447758:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787862388.447794:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246464384 00000100:00100000:2.0:1787862388.447801:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246464384 00000100:00100000:2.0:1787862388.447836:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862388.447843:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c100780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3330:x1874709246464384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787862388.447965:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787862388.447968:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787862388 00002000:00010000:2.0:1787862388.447971:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787862388.447973:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787862388 -> 1787862388 00002000:00010000:2.0:1787862388.447975:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787862388.448011:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c100780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3330:x1874709246464384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (2461us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787862388.448018:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1787862388.448115:0:3330:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13cb7ad00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787862388.448123:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246464384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1787862388.450134:0:3327:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13cb8e1c0/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787862388.450154:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246464128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787862388.458571:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.458702:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406848 00000100:00100000:2.0:1787862388.458712:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406848 00010000:00010000:2.0:1787862388.458847:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 13 pid: 6711 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862388.458962:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:2.0:1787862388.458974:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2352:x1874709223406848:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862388.458991:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862388.458998:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 13 pid: 6711 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.459014:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 13 pid: 6711 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.459086:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862388.459092:0:5855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862388.459099:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.459110:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.459132:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862388.459185:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+13:2352:x1874709223406848:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 213us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.459210:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00010000:00010000:3.0:1787862388.459372:0:12084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cda832 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0888 expref: 12 pid: 6711 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.459390:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12084:1874709246464512:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862388.459421:0:12084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.459432:0:12084:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.459440:0:12084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.459450:0:12084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.459527:0:12084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.459553:0:12084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787862388.465574:0:3328:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13cb7b840/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787862388.465584:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246464256:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787862388.465941:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862388.465951:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.465963:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862388.465969:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.465981:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.466002:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.466010:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.466075:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862388.466087:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862388.466089:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862388.466931:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3328:x1874709246464256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23061us (23488us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787862388.466950:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787862388.471943:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.472104:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223406976 00000100:00100000:2.0:1787862388.472114:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223406976 00000100:00100000:2.0:1787862388.472170:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:2.0:1787862388.472179:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+12:2352:x1874709223406976:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787862388.604267:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787862388.604293:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1787862388.604303:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1787862388.604311:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1787862388.604963:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223406976:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 132777us (133024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.604981:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:2.0:1787862388.610498:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.610592:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223407232 00000100:00100000:3.0:1787862388.610601:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223407232 00000100:00100000:3.0:1787862388.610665:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 228 00000100:00100000:3.0:1787862388.610691:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11701:x1874709223407232:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862388.610762:0:9468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862388.610788:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaa5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c091b expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.610808:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:3.0:1787862388.610813:0:9468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862388.610842:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.610866:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.610876:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862388.611192:0:9468:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e8fee95f reply state 00000000640e34fe transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.611202:0:9468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862388.611374:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:11701:x1874709223407232:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 684us (884us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787862388.611381:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 228 00010000:00010000:3.0:1787862388.613847:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.613878:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.613886:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.613905:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862388.613910:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.613918:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.613935:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:3.0:1787862388.613938:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862388.613944:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.613950:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaa7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862388.630511:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.633459:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223407360 00000100:00100000:3.0:1787862388.633554:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223407360 00000100:00100000:3.0:1787862388.633697:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:3.0:1787862388.633710:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223407360:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787862388.633998:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787862388.634002:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787862388 -> 1787862387 00002000:00010000:3.0:1787862388.634005:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787862386 00002000:00010000:3.0:1787862388.634007:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787862388 -> 1787862387 00002000:00010000:3.0:1787862388.634009:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787862388.634136:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2353:x1874709223407360:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 427us (3634us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787862388.634144:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:0.0:1787862388.638438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862388.638592:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223407616 00000100:00100000:1.0:1787862388.638600:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223407616 00000100:00100000:1.0:1787862388.638686:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:1.0:1787862388.638696:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:11701:x1874709223407616:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787862388.638779:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.638799:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.638831:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.639007:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.639023:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 20 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862388.639038:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb88000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246464640:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862388.639211:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862388.645537:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.646368:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223407744 00000100:00100000:0.0:1787862388.646398:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223407744 00010000:00010000:0.0:1787862388.646441:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.646497:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:0.0:1787862388.646507:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:2352:x1874709223407744:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862388.646522:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862388.646530:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.646545:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.646571:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:0.0:1787862388.646577:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.646587:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.646595:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.646618:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862388.646697:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:2352:x1874709223407744:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 192us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862388.646706:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00010000:00010000:1.0:1787862388.648455:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e800/0x391a6cd368cdaa3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c090d expref: 20 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862388.648612:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb88000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5870:1874709246464640:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862388.648639:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648650:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648657:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648833:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648841:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648935:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648941:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862388.648945:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648953:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648967:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:1.0:1787862388.648970:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787862388.648975:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.648982:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9a00/0x391a6cd368cdaa85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862388.649214:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11701:x1874709223407616:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 10517us (10784us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787862388.649224:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:2.0:1787862388.653596:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.653709:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223407872 00000100:00100000:3.0:1787862388.653800:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223407872 00000100:00100000:3.0:1787862388.653964:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:3.0:1787862388.653978:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223407872:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787862388.654028:0:12084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.654189:0:12084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.654200:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862388.654204:0:12084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862388.654209:0:12084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.654267:0:12084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 8 pid: 9223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.654284:0:12084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 8 pid: 9223 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.654301:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c100f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12084:1874709246464768:192.168.202.9@tcp:104: 00000100:00100000:3.0:1787862388.654603:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108729240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862388.659397:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.659561:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c100f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12084:1874709246464768:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862388.659588:0:12084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.659980:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223408000 00000100:00100000:0.0:1787862388.659989:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223408000 00010000:00010000:0.0:1787862388.660032:0:5854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 9 pid: 9223 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.660212:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:0.0:1787862388.660223:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+9:2352:x1874709223408000:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862388.660250:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862388.660287:0:5854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 9 pid: 9223 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.660301:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 9 pid: 9223 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.660326:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000324bea4d/0x391a6cd368cdaa69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0929 expref: 9 pid: 9223 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.660342:0:5854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862388.660347:0:5854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862388.660352:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.660361:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.660392:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862388.660457:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223408000:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 236us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862388.660474:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00010000:00010000:3.0:1787862388.660543:0:12084:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660553:0:12084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660583:0:12084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660591:0:12084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660599:0:12084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660606:0:12084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862388.660611:0:12084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660619:0:12084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660631:0:12084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.660650:0:12084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef9f352b/0x391a6cd368cdaa8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862388.660712:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223407872:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 6739us (7128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.660721:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:3.0:1787862388.665001:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862388.665191:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223408256 00000100:00100000:1.0:1787862388.665203:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223408256 00000100:00100000:1.0:1787862388.665276:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 230 00000100:00100000:1.0:1787862388.665287:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c100f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11701:x1874709223408256:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862388.665368:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665388:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665413:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665666:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665679:0:9468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665688:0:9468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665735:0:9468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.665751:0:9468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 20 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862388.665764:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246464896:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862388.665938:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862388.673057:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.673358:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223408384 00000100:00100000:0.0:1787862388.673367:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223408384 00010000:00010000:0.0:1787862388.673414:0:8522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.673453:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:0.0:1787862388.674002:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:2352:x1874709223408384:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862388.674021:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862388.674029:0:8522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.674388:0:8522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.674415:0:8522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:0.0:1787862388.674421:0:8522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.674431:0:8522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.674439:0:8522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.674660:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e000/0x391a6cd368cdaa4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0914 expref: 21 pid: 5868 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.674975:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862388.675167:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246464896:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862388.675191:0:9468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.675386:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:2352:x1874709223408384:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1923us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862388.675398:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00010000:00010000:2.0:1787862388.677816:0:9468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.677834:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862388.678507:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787862388.678664:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787862388.678709:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787862388.678991:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9468:1874709246465024:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787862388.679278:0:9468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862388.679317:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1032c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862388.679430:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246465024 00000100:00100000:0.0:1787862388.679444:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246465024 00000100:00100000:0.0:1787862388.679513:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862388.679523:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9468:x1874709246465024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787862388.679618:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9468:x1874709246465024:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862388.679626:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862388.679663:0:9468:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787862388.679669:0:9468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1787862388.679687:0:9468:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13cb7ad00, transno 4294967321 00000004:00080000:0.0:1787862388.679694:0:9468:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13cb7b840, transno 4294967322 00000100:00100000:0.0:1787862388.679701:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9468:1874709246465024:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787862388.680198:0:9468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787862388.680428:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8d680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9468:1874709246465152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787862388.680464:0:9468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862388.680486:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862388.680503:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246465152 00000100:00100000:0.0:1787862388.680507:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246465152 00000100:00100000:0.0:1787862388.680530:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862388.680537:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9468:x1874709246465152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787862388.680723:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9468:x1874709246465152:12345-0@lo:1000:mdt00_003.0 Request processed in 185us (257us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787862388.680730:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862388.680767:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8d680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9468:1874709246465152:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787862388.680801:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680812:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680826:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680833:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862388.680838:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680847:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680864:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a1205e1700) 00010000:00010000:0.0:1787862388.680868:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862388.680872:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680880:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaa9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680913:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680920:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680925:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680931:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862388.680934:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680951:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680961:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862388.680964:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862388.680971:0:9468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680984:0:9468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.680994:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.681020:0:9468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.681031:0:9468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246465280:192.168.202.9@tcp:105: 00000100:00100000:0.0:1787862388.681141:0:9468:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102981cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862388.692137:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862388.692251:0:9468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9468:1874709246465280:192.168.202.9@tcp:105: 00010000:00010000:0.0:1787862388.692291:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692303:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f400/0x391a6cd368cda9dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692351:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692380:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692393:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692404:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692411:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692418:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692424:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862388.692428:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692436:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692447:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862388.692451:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862388.692455:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692472:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692483:0:9468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692495:0:9468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692502:0:9468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692507:0:9468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862388.692511:0:9468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692517:0:9468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692527:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862388.692529:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787862388.692533:0:9468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.692539:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaa93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862388.692785:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c100f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:11701:x1874709223408256:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 27498us (27793us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787862388.692796:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 230 00000020:00080000:0.0:1787862388.692803:0:9468:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787862388.693597:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862388.693605:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862388.694132:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787862388.694142:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862388.694695:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223408512 00000100:00100000:3.0:1787862388.694704:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223408512 00000100:00100000:3.0:1787862388.694776:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:3.0:1787862388.694786:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:11700:x1874709223408512:12345-192.168.202.9@tcp:49:lfs.0 00000100:00100000:3.0:1787862388.694912:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:11700:x1874709223408512:12345-192.168.202.9@tcp:49:lfs.0 Request processed in 126us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.694919:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:1.0:1787862388.701396:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862388.701612:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862388.701753:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223409024 00000100:00100000:3.0:1787862388.701763:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223409024 00000100:00100000:3.0:1787862388.701822:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:3.0:1787862388.701832:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+23:11701:x1874709223409024:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862388.703617:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223408768 00000100:00100000:2.0:1787862388.703628:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223408768 00000100:00100000:2.0:1787862388.703699:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:2.0:1787862388.703709:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:11700:x1874709223408768:12345-192.168.202.9@tcp:58:lfs.0 00000004:00080000:0.0:1787862388.704443:0:5871:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787862388.704529:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787862388.704596:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.704622:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.704633:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.704642:0:5871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.704648:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.704655:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862388.704693:0:5871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787862388.704816:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11701:x1874709223409024:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 2982us (3201us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787862388.704826:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000020:00080000:0.0:1787862388.704831:0:5871:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787862388.705874:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862388.705886:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.705897:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862388.705902:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.705912:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.705931:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89a116882800) 00010000:00010000:1.0:1787862388.705934:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862388.705939:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.705946:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9800/0x391a6cd368cdaaa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.705974:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862388.705975:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862388.705977:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862388.708318:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787862388.708482:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:11700:x1874709223408768:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 4769us (7093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.708492:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:1.0:1787862388.768903:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862388.768941:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223409152 00000100:00100000:1.0:1787862388.768950:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223409152 00000100:00100000:1.0:1787862388.769006:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 232 00000100:00100000:1.0:1787862388.769016:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+25:11703:x1874709223409152:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1787862388.769063:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862388.769096:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cdaaaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0930 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.769175:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.769193:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.769205:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.769219:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.769226:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.771440:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.772788:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.772811:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 26 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.772821:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.772864:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 26 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862388.772894:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 26 pid: 5870 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862388.772909:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246465408:192.168.202.9@tcp:104: 00000100:00100000:1.0:1787862388.773006:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105e54b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862388.778032:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5869:1874709246465408:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862388.778096:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862388.782953:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.784876:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223409408 00000100:00100000:2.0:1787862388.784892:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223409408 00000100:00100000:2.0:1787862388.784947:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:2.0:1787862388.784958:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:5596:x1874709223409408:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787862388.786436:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:5596:x1874709223409408:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 1466us (3479us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787862388.786453:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:0.0:1787862388.790624:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862388.790767:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223409536 00000100:00100000:2.0:1787862388.790779:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223409536 00010000:00010000:2.0:1787862388.790823:0:5855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 28 pid: 5870 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862388.790870:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:2.0:1787862388.790881:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:2353:x1874709223409536:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862388.790897:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862388.790905:0:5855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 28 pid: 5870 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.790919:0:5855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 28 pid: 5870 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.790962:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160400/0x391a6cd368cda9cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f1 expref: 28 pid: 5870 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.790979:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:2.0:1787862388.790985:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.790996:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.791005:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862388.791085:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862388.791143:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+27:2353:x1874709223409536:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 263us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862388.791151:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00010000:00010000:3.0:1787862388.791387:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791396:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862388.791438:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787862388.791443:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862388.791471:0:5869:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791483:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791493:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791500:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791507:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791513:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862388.791518:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791526:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791547:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862388.791550:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862388.791554:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791560:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9000/0x391a6cd368cdaab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791571:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791576:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791582:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791587:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862388.791590:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791596:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791602:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89a104fc5500) 00010000:00010000:3.0:1787862388.791604:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862388.791607:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791612:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8e00/0x391a6cd368cdaabd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791664:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8000/0x391a6cd368cdaaaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0930 expref: 27 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791677:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0930 expref: 26 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862388.791685:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862388.791687:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862388.791689:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8600, rc 0) 00000100:00100000:3.0:1787862388.791722:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11703:x1874709223409152:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 22707us (22830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862388.791729:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 232 00000001:00080000:1.0:1787862388.805927:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787862388.805941:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787862388.805951:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1787862388.868274:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862389.688579:0:12534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862389.688590:0:12534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862389.688630:0:12534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787862389.688635:0:12534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787862389.702423:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862389.702433:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862389.702472:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787862389.702480:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862389.702617:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246465536:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862389.702718:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862389.719696:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862389.719844:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11754:1874709246465536:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787862389.721108:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223409664 00000100:00100000:2.0:1787862389.721117:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223409664 00000100:00100000:2.0:1787862389.721190:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 233 00000100:00100000:2.0:1787862389.721201:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c103840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11714:x1874709223409664:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862389.721242:0:5870:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862389.721366:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c103840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11714:x1874709223409664:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 166us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862389.721374:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 233 00000100:00100000:3.0:1787862389.725550:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862389.725666:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223409920 00000100:00100000:1.0:1787862389.725678:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223409920 00000100:00100000:1.0:1787862389.725899:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 234 00000100:00100000:1.0:1787862389.725911:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c102d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+26:11714:x1874709223409920:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862389.725936:0:9468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862389.725960:0:9468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cdaacb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0937 expref: -99 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862389.726119:0:9468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cdaad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862389.726134:0:9468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cdaad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862389.726148:0:9468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cdaad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862389.726173:0:9468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787862389.726377:0:9468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8a00/0x391a6cd368cdaacb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0937 expref: 29 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862389.726395:0:9468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cdaad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0937 expref: 28 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862389.726404:0:9468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862389.726407:0:9468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862389.726411:0:9468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8400, rc 0) 00000100:00100000:1.0:1787862389.726560:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c102d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:11714:x1874709223409920:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 650us (1021us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787862389.726568:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 234 00000100:00100000:0.0:1787862389.752919:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862389.752955:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862389.752992:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223410176 00000100:00100000:0.0:1787862389.753003:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223410176 00000100:00100000:0.0:1787862389.753090:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 235 00000100:00100000:0.0:1787862389.753100:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:11714:x1874709223410176:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787862389.753189:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753209:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753222:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753412:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753420:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753427:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753434:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862389.753438:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753446:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753475:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862389.753478:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787862389.753490:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753496:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1420e9c00/0x391a6cd368cdaae0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862389.753639:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:11714:x1874709223410176:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 539us (731us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787862389.753647:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 235 00000100:00100000:0.0:1787862389.753673:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223410304 00000100:00100000:0.0:1787862389.753677:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223410304 00000100:00100000:0.0:1787862389.753707:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1787862389.753713:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:2355:x1874709223410304:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862389.753724:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862389.753738:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8400/0x391a6cd368cdaad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0937 expref: 29 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862389.753749:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:0.0:1787862389.753753:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862389.753771:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:2355:x1874709223410304:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 58us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862389.753778:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000040:00080000:0.0:1787862389.753883:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862389.753887:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862389.754414:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787862389.754422:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862389.762899:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862389.762979:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223410560 00000100:00100000:1.0:1787862389.762995:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223410560 00000100:00100000:1.0:1787862389.763100:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:1.0:1787862389.763111:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+28:11714:x1874709223410560:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787862389.763385:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:11714:x1874709223410560:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 275us (494us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787862389.763394:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00010000:00010000:0.0:1787862389.892269:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862390.788523:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862390.788537:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862390.788597:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787862390.788604:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862390.788902:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862390.788920:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246465664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862390.788994:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862390.789159:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246465664 00000100:00100000:1.0:1787862390.789167:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246465664 00000100:00100000:1.0:1787862390.789234:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787862390.789245:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246465664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862390.789280:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862390.789339:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246465664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862390.789348:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787862390.789408:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862390.789526:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787862390.789532:0:3329:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13cb70780, transno 4294967307 00000004:00080000:0.0:1787862390.789550:0:3329:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787862390.789570:0:3329:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13cb8e1c0, transno 4294967310 00000100:00100000:0.0:1787862390.789584:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246465664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862390.916155:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862391.671973:0:12585:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862391.671984:0:12585:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862391.672027:0:12585:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787862391.672034:0:12585:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862391.929803:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862391.929865:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223410816 00000100:00100000:3.0:1787862391.929877:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223410816 00000100:00100000:3.0:1787862391.929965:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 236 00000100:00100000:3.0:1787862391.929979:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+29:11736:x1874709223410816:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1787862391.930023:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862391.930079:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaae7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c093e expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.930189:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaaee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.930204:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaaee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.930219:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaaee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862391.930231:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787862391.930365:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100031600/0x391a6cd368cdaae7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c093e expref: 32 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.930384:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaaee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c093e expref: 31 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.930392:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862391.930395:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787862391.930399:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030c00, rc 0) 00000100:00100000:3.0:1787862391.930465:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:11736:x1874709223410816:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 489us (674us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787862391.930472:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 236 00000100:00080000:2.0:1787862391.933719:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862391.934304:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862391.934475:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223410944 00000100:00100000:3.0:1787862391.934488:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223410944 00000100:00100000:3.0:1787862391.934554:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 237 00000100:00100000:3.0:1787862391.934581:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:11736:x1874709223410944:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1787862391.934663:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934681:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934707:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934734:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934741:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934748:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934754:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862391.934759:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934767:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934780:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:3.0:1787862391.934783:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862391.934788:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862391.934793:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030e00/0x391a6cd368cdaafc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862391.934883:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+31:11736:x1874709223410944:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 303us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862391.934891:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 237 00010000:00010000:3.0:1787862391.943083:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862392.117289:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862392.117471:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411072 00000100:00100000:2.0:1787862392.117483:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411072 00000100:00100000:2.0:1787862392.117570:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:2.0:1787862392.117581:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c102940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2352:x1874709223411072:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:2.0:1787862392.117603:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862392.117627:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab0fb8b/0x391a6cd368cdab03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0945 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862392.117656:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a909d73, atime: 0x6a909d72, ctime: 0x6a909d73, blocks: 0xb 00010000:00010000:2.0:1787862392.117679:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1787862392.117684:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862392.117710:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab0fb8b/0x391a6cd368cdab03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0945 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862392.117730:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ab0fb8b/0x391a6cd368cdab03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0945 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862392.117745:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f400, rc 0) 00000100:00100000:2.0:1787862392.117816:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c102940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223411072:12345-192.168.202.9@tcp:101:cat.0 Request processed in 236us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862392.117824:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00080000:3.0:1787862392.118969:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862392.124284:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862392.124380:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411200 00000100:00100000:3.0:1787862392.124389:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411200 00002000:00100000:3.0:1787862392.124440:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff89a13cb8b0c0 x1874709223411200/t0(0) o3->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:508/0 lens 488/0 e 0 to 0 dl 1787862403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862392.124452:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13cb8b0c0 with x1874709223411200 ext(0->4095) 00002000:00010000:3.0:1787862392.124458:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13cb8b0c0 00000100:00100000:3.0:1787862392.124492:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862392.124502:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223411200:12345-192.168.202.9@tcp:3:cat.0 00000100:00100000:3.0:1787862392.124761:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+8:2352:x1874709223411200:12345-192.168.202.9@tcp:3:cat.0 Request processed in 260us (488us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787862392.124770:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00002000:00100000:3.0:1787862392.124777:0:6715:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff89a13cb8b0c0 x1874709223411200/t0(0) o3->c20d7abe-3b31-4da4-909a-c5bb95bfc247@192.168.202.9@tcp:508/0 lens 488/4536 e 0 to 0 dl 1787862403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862392.124786:0:6715:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff89a13cb8b0c0 with x1874709223411200 ext(0->4095) 00002000:00010000:3.0:1787862392.124789:0:6715:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a13cb8b0c0 00000100:00100000:1.0:1787862392.155220:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862392.155274:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862392.155337:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862392.155486:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411456 00000100:00100000:0.0:1787862392.155497:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411456 00000100:00100000:3.0:1787862392.155567:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411584 00000100:00100000:3.0:1787862392.155580:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411584 00000100:00100000:0.0:1787862392.155588:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 106 00000100:00100000:0.0:1787862392.155607:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223411456:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862392.155633:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411328 00000100:00100000:2.0:1787862392.155639:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411328 00000100:00100000:3.0:1787862392.155671:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 187 00000100:00100000:2.0:1787862392.155684:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 308 00000100:00100000:3.0:1787862392.155690:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223411584:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862392.155703:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2353:x1874709223411456:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862392.155710:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223411328:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862392.155713:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 106 00000100:00100000:2.0:1787862392.155768:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223411328:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 59us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862392.155776:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 308 00000100:00100000:3.0:1787862392.155798:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2353:x1874709223411584:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 115us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862392.155809:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 187 00000100:00080000:0.0:1787862392.158584:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862392.158598:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862392.836433:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246466048:0@lo:400:kworker.0 00000100:00100000:0.0:1787862392.836523:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862392.836599:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862392.836606:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246466176:0@lo:400:kworker.0 00000100:00100000:0.0:1787862392.836635:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862392.836691:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466048 00000100:00100000:0.0:1787862392.836699:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466048 00000100:00100000:0.0:1787862392.836766:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787862392.836794:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246466048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862392.836869:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246466048:12345-0@lo:400:kworker.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862392.836878:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787862392.837014:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466176 00000100:00100000:1.0:1787862392.837018:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466176 00000100:00100000:1.0:1787862392.837085:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787862392.837093:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246466176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862392.837130:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246466176:12345-0@lo:400:kworker.0 Request processed in 39us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862392.837136:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1787862392.837158:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862392.837162:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862392.837199:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246466176:0@lo:400:kworker.0 00000100:00100000:1.0:1787862392.837210:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246466048:0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.837399:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246465792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.837590:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862392.837617:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246466304:0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.837645:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862392.837669:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862392.837675:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246465920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.837699:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862392.837715:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246466432:0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.837739:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862392.837767:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466304 00000100:00100000:2.0:1787862392.837772:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466304 00000100:00100000:2.0:1787862392.837801:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246465920 00000100:00100000:2.0:1787862392.837804:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246465920 00000100:00100000:2.0:1787862392.837817:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787862392.837825:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246466304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.837879:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246466304:12345-0@lo:400:kworker.0 Request processed in 55us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862392.837997:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466432 00000100:00100000:3.0:1787862392.838002:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466432 00000100:00100000:3.0:1787862392.838071:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787862392.838080:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246466432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862392.838118:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3327:x1874709246466432:12345-0@lo:400:kworker.0 Request processed in 39us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862392.838124:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787862392.838157:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787862392.838164:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246465920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862392.838193:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246465920:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862392.838199:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1787862392.838226:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862392.838231:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862392.838255:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246465920:0@lo:400:kworker.0 00000100:00100000:3.0:1787862392.838267:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246466432:0@lo:400:kworker.0 00000100:00100000:3.0:1787862392.838278:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246466304:0@lo:400:kworker.0 00000100:00100000:1.0:1787862392.838490:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246465792 00000100:00100000:1.0:1787862392.838495:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246465792 00000100:00100000:1.0:1787862392.838533:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787862392.838541:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246465792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862392.838588:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246465792:12345-0@lo:400:kworker.0 Request processed in 48us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862392.838594:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787862392.838646:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246465792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862392.838788:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:0.0:1787862392.965575:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862393.348533:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862393.348584:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246466560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862393.348685:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862393.353887:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466560 00000100:00100000:3.0:1787862393.353917:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466560 00000100:00100000:3.0:1787862393.354021:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862393.354068:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246466560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862393.354138:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862393.354303:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246466560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 270us (5616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862393.354312:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862393.354408:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246466560:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787862393.442458:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:3.0:1787862393.442477:0:5890:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a10676ad80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787862393.442482:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a1117bd800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a10676a240 00000020:00080000:3.0:1787862393.442485:0:5890:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a1117bd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a13c142400 00000001:00080000:3.0:1787862393.442507:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1787862393.442535:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787862393.442543:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787862393.444235:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787862393.444682:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787862393.992857:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787862394.014312:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787862394.014341:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1787862395.019616:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862395.909158:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862395.909190:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246466688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862395.909283:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862395.909366:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466688 00000100:00100000:3.0:1787862395.909376:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466688 00000100:00100000:3.0:1787862395.909441:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787862395.909452:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c103c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246466688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862395.909503:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862395.909560:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c103c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246466688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862395.909569:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787862395.909597:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862395.909654:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246466688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862396.042597:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862397.063924:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862397.274348:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862397.274401:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862397.274430:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862397.274454:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862397.274481:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862397.274508:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411968 00000100:00100000:1.0:1787862397.274519:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411968 00000100:00100000:1.0:1787862397.274587:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412096 00000100:00100000:1.0:1787862397.274590:0:9223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412096 00000100:00100000:1.0:1787862397.274613:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:1.0:1787862397.274624:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223411968:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862397.274777:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411840 00000100:00100000:3.0:1787862397.274794:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411840 00000100:00100000:3.0:1787862397.274824:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412224 00000100:00100000:3.0:1787862397.274826:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412224 00000100:00100000:3.0:1787862397.274846:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 191 00000100:00100000:3.0:1787862397.274853:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:2353:x1874709223411840:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862397.274945:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:2353:x1874709223411840:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 92us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862397.274954:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 191 00000100:00100000:3.0:1787862397.274974:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:3.0:1787862397.274979:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223412224:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862397.275012:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2352:x1874709223412224:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862397.275019:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:2.0:1787862397.275121:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223411712 00000100:00100000:2.0:1787862397.275126:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223411712 00000100:00100000:2.0:1787862397.275175:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 310 00000100:00100000:2.0:1787862397.275184:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223411712:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862397.275224:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2352:x1874709223411712:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 41us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862397.275231:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 310 00000100:00100000:1.0:1787862397.275356:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2352:x1874709223411968:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 734us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862397.275365:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:1.0:1787862397.275450:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:1.0:1787862397.275459:0:9223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223412096:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862397.275490:0:9223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2353:x1874709223412096:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862397.275496:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00080000:1.0:1787862397.275526:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862397.275538:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862397.275540:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862397.959118:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246467200:0@lo:400:kworker.0 00000100:00100000:2.0:1787862397.959238:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862397.959338:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862397.959346:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246467072:0@lo:400:kworker.0 00000100:00100000:2.0:1787862397.959379:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862397.960542:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246466944:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.960614:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862397.960664:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246467456:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.960690:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862397.960732:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787862397.960738:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246466816:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.960769:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862397.960792:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246467328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.960814:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862397.960855:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467072 00000100:00100000:3.0:1787862397.960865:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467072 00000100:00100000:3.0:1787862397.960928:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466944 00000100:00100000:3.0:1787862397.960931:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466944 00000100:00100000:3.0:1787862397.960961:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467328 00000100:00100000:3.0:1787862397.960964:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467328 00000100:00100000:3.0:1787862397.960978:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787862397.960987:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246467072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961118:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c6a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246467072:12345-0@lo:400:kworker.0 Request processed in 130us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862397.961126:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787862397.961144:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787862397.961149:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246466944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961178:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246466944:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862397.961185:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787862397.961196:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787862397.961201:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246467328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961227:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246467328:12345-0@lo:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862397.961233:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787862397.961252:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246466816 00000100:00100000:3.0:1787862397.961256:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246466816 00000100:00100000:3.0:1787862397.961282:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787862397.961289:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246466816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961318:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246466816:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862397.961324:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787862397.961389:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246467072:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961419:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246466816:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961442:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246467328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862397.961452:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246466944:0@lo:400:kworker.0 00000100:00100000:1.0:1787862397.961976:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467200 00000100:00100000:1.0:1787862397.961984:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467200 00000100:00100000:1.0:1787862397.962062:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467456 00000100:00100000:1.0:1787862397.962066:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467456 00000100:00100000:1.0:1787862397.962103:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787862397.962111:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246467200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862397.962176:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246467200:12345-0@lo:400:kworker.0 Request processed in 65us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862397.962183:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787862397.962197:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787862397.962203:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246467456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862397.962239:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246467456:12345-0@lo:400:kworker.0 Request processed in 36us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862397.962244:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787862397.962266:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862397.962270:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862397.962273:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862397.962309:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246467200:0@lo:400:kworker.0 00000100:00100000:1.0:1787862397.962338:0:3328:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787862397.962344:0:3328:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787862397.962363:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246467456:0@lo:400:kworker.0 00010000:00010000:3.0:1787862398.084676:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862398.279880:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862398.280205:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412352 00000100:00100000:3.0:1787862398.280219:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412352 00000100:00100000:3.0:1787862398.280307:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 238 00000100:00100000:3.0:1787862398.280320:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11388:x1874709223412352:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787862398.280490:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11388:x1874709223412352:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 Request processed in 172us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862398.280499:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 238 00000100:00100000:1.0:1787862398.288124:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862398.288508:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412608 00000100:00100000:2.0:1787862398.288522:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412608 00000100:00100000:2.0:1787862398.288600:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:2.0:1787862398.288612:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:11388:x1874709223412608:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862398.289493:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:11388:x1874709223412608:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 879us (1381us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787862398.289504:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:1.0:1787862398.471543:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862398.471580:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246467584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862398.471690:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862398.472549:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467584 00000100:00100000:0.0:1787862398.472562:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467584 00000100:00100000:0.0:1787862398.472626:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862398.472637:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246467584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862398.472688:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862398.472769:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246467584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862398.472777:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787862398.474893:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d35e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246467584:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1787862398.517715:0:5890:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787862398.517783:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787862398.517794:0:5901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1787862398.518492:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000100:00100000:1.0:1787862398.708299:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862398.708389:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412736 00000100:00100000:2.0:1787862398.708400:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412736 00000100:00100000:2.0:1787862398.708461:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 239 00000100:00100000:2.0:1787862398.708482:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:12187:x1874709223412736:12345-192.168.202.9@tcp:101:lsof.0 00010000:00010000:2.0:1787862398.708506:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862398.708531:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdab0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c094c expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862398.708605:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cdab11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862398.708648:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cdab11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862398.708662:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cdab11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862398.709216:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862398.709221:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862398.709304:0:5868:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cdab11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862398.709332:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e200/0x391a6cd368cdab0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c094c expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862398.709351:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cdab11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c094c expref: 6 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862398.709360:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:2.0:1787862398.709363:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862398.709367:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f800, rc 0) 00000100:00100000:2.0:1787862398.709448:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:12187:x1874709223412736:12345-192.168.202.9@tcp:101:lsof.0 Request processed in 976us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862398.709456:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 239 00010000:00010000:2.0:1787862399.111510:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862400.004639:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862400.004650:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862400.005507:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787862400.005518:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787862400.132202:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862401.028283:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862401.028314:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246467712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862401.028401:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.028473:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467712 00000100:00100000:0.0:1787862401.028492:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467712 00000100:00100000:0.0:1787862401.028700:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787862401.028718:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c101e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246467712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862401.028778:0:6713:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862401.028884:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c101e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246467712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.028893:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787862401.030561:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246467712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862401.032218:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862401.157112:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862401.984601:0:12787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:26:40 (1787862400) 00010000:00010000:1.0:1787862402.181941:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862402.388909:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862402.388981:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862402.389108:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862402.389126:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412992 00000100:00100000:0.0:1787862402.389145:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862402.389148:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412992 00000100:00100000:0.0:1787862402.389189:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862402.389237:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223413248 00000100:00100000:0.0:1787862402.389247:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223413248 00000100:00100000:3.0:1787862402.389276:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223413376 00000100:00100000:3.0:1787862402.389284:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223413376 00000100:00100000:0.0:1787862402.389320:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223413120 00000100:00100000:0.0:1787862402.389338:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223413120 00000100:00100000:3.0:1787862402.389347:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:3.0:1787862402.389367:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:2354:x1874709223412992:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862402.389393:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:0.0:1787862402.389406:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2354:x1874709223413248:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862402.389483:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d35e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:2354:x1874709223412992:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 122us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862402.389494:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:2.0:1787862402.389529:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:2.0:1787862402.389556:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223413120:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862402.389895:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 197 00000100:00100000:3.0:1787862402.389910:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2354:x1874709223413376:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862402.390095:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2354:x1874709223413248:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 689us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862402.390104:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00080000:0.0:1787862402.391870:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862402.391884:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862402.391889:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862402.391912:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223412864 00000100:00100000:0.0:1787862402.391924:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223412864 00000100:00100000:0.0:1787862402.392027:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 312 00000100:00100000:0.0:1787862402.392058:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223412864:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862402.392154:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2354:x1874709223412864:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 115us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862402.392163:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 312 00000100:00100000:2.0:1787862402.403221:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112c50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2354:x1874709223413120:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 13644us (14052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862402.403245:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1787862402.411070:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a00838a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2354:x1874709223413376:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21122us (21839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862402.411087:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 197 00000100:00100000:0.0:1787862403.076507:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246467968:0@lo:400:kworker.0 00000100:00100000:1.0:1787862403.076674:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246468224:0@lo:400:kworker.0 00000100:00100000:1.0:1787862403.076710:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862403.076767:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862403.076774:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246468096:0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.076820:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862403.076861:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246468480:0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.076885:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862403.076910:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787862403.076916:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d85b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246467840:0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.076954:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862403.076976:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246468352:0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.076998:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862403.077031:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468224 00000100:00100000:0.0:1787862403.077064:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468224 00000100:00100000:1.0:1787862403.077302:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467968 00000100:00100000:1.0:1787862403.077306:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467968 00000100:00100000:1.0:1787862403.077369:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468352 00000100:00100000:1.0:1787862403.077373:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468352 00000100:00100000:1.0:1787862403.077398:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787862403.077406:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246467968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862403.077464:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246467968:12345-0@lo:400:kworker.0 Request processed in 58us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862403.077472:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787862403.077491:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787862403.077497:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246468352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862403.077524:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246468352:12345-0@lo:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862403.077530:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787862403.077724:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468480 00000100:00100000:0.0:1787862403.077728:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468480 00000100:00100000:0.0:1787862403.077754:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787862403.077760:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246468224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.077795:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246468224:12345-0@lo:400:kworker.0 Request processed in 34us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862403.077801:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787862403.077815:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787862403.077821:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246468480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.077844:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246468480:12345-0@lo:400:kworker.0 Request processed in 24us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862403.077849:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787862403.077868:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246467840 00000100:00100000:0.0:1787862403.077871:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246467840 00000100:00100000:0.0:1787862403.077892:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787862403.077898:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246467840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.077925:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246467840:12345-0@lo:400:kworker.0 Request processed in 27us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862403.077954:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:0.0:1787862403.077991:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862403.077995:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862403.077997:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862403.078012:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862403.078079:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246468224:0@lo:400:kworker.0 00000100:00100000:2.0:1787862403.078450:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468096 00000100:00100000:2.0:1787862403.078455:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468096 00000100:00100000:2.0:1787862403.078491:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787862403.078498:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246468096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862403.078537:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246468096:12345-0@lo:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862403.078542:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787862403.080246:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862403.080296:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d85b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246467840:0@lo:400:kworker.0 00000100:00100000:2.0:1787862403.080315:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246468352:0@lo:400:kworker.0 00000100:00100000:0.0:1787862403.081465:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246468096:0@lo:400:kworker.0 00000100:00100000:2.0:1787862403.082259:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246467968:0@lo:400:kworker.0 00000100:00100000:2.0:1787862403.082282:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246468480:0@lo:400:kworker.0 00010000:00010000:1.0:1787862403.205144:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862403.591732:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246468608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862403.592130:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862403.593241:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468608 00000100:00100000:2.0:1787862403.593252:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468608 00000100:00100000:2.0:1787862403.593303:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787862403.593314:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246468608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862403.593364:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862403.593435:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246468608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862403.593444:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862403.602792:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246468608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862404.231346:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862405.252351:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862406.149862:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862406.149897:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c100b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246468736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862406.150022:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862406.150107:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468736 00000100:00100000:2.0:1787862406.150119:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468736 00000100:00100000:2.0:1787862406.150216:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862406.150228:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246468736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862406.150275:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862406.150519:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246468736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 291us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862406.150527:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787862406.150591:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c100b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246468736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862406.150777:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862406.276217:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862407.093883:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862407.095697:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223413632 00000100:00100000:2.0:1787862407.095713:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223413632 00000100:00100000:2.0:1787862407.095875:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:2.0:1787862407.095889:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+18:12408:x1874709223413632:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:2.0:1787862407.096528:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:12408:x1874709223413632:12345-192.168.202.9@tcp:35:umount.0 Request processed in 640us (2652us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787862407.096538:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00080000:3.0:1787862407.101864:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862407.105793:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862407.107863:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223413888 00000100:00100000:1.0:1787862407.107879:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223413888 00000100:00100000:1.0:1787862407.107953:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:1.0:1787862407.107964:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+19:12408:x1874709223413888:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:1.0:1787862407.108913:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:12408:x1874709223413888:12345-192.168.202.9@tcp:35:umount.0 Request processed in 935us (3118us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787862407.108926:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:0.0:1787862407.116715:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862407.116913:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223414144 00000100:00100000:2.0:1787862407.116924:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223414144 00000100:00100000:2.0:1787862407.117025:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:2.0:1787862407.117037:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111c4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+20:12408:x1874709223414144:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:2.0:1787862407.118767:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111c4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:12408:x1874709223414144:12345-192.168.202.9@tcp:35:umount.0 Request processed in 1723us (2053us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787862407.118781:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:0.0:1787862407.132490:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862407.132576:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223414400 00000100:00100000:1.0:1787862407.132588:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223414400 00000100:00100000:1.0:1787862407.132652:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:1.0:1787862407.132662:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+21:12408:x1874709223414400:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:1.0:1787862407.133021:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:12408:x1874709223414400:12345-192.168.202.9@tcp:35:umount.0 Request processed in 360us (540us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787862407.133029:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:2.0:1787862407.138995:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862407.139492:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862407.139651:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223414528 00000100:00100000:1.0:1787862407.139661:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223414528 00000100:00100000:1.0:1787862407.139724:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223414656 00000100:00100000:1.0:1787862407.139727:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223414656 00000100:00100000:1.0:1787862407.139752:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1787862407.139761:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+14:2353:x1874709223414528:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862407.139776:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862407.139798:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030200/0x391a6cd368cd9b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04d7 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.139831:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862407.139884:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+13:2353:x1874709223414528:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 123us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862407.139892:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1787862407.139919:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:1.0:1787862407.139927:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+12:2353:x1874709223414656:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862407.139935:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862407.139944:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a142161e00/0x391a6cd368cd9d81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05a2 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.139954:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862407.139972:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:2353:x1874709223414656:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 46us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862407.139979:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1787862407.140414:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862407.140921:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223414784 00000100:00100000:0.0:1787862407.140927:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223414784 00000100:00100000:0.0:1787862407.140974:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1787862407.140983:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+11:2355:x1874709223414784:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862407.140993:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862407.141006:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211600/0x391a6cd368cd9aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c049f expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862407.141019:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862407.141106:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2355:x1874709223414784:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 119us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862407.141128:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1787862407.143823:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862407.143930:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223415168 00000100:00100000:1.0:1787862407.143940:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223415168 00000100:00100000:1.0:1787862407.144015:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:1.0:1787862407.144026:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2351:x1874709223415168:12345-192.168.202.9@tcp:9:umount.0 00000020:00000080:1.0:1787862407.144109:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cda0c2 00000020:00010000:1.0:1787862407.144119:0:6709:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89a13d571800: total 0 00000100:00080000:1.0:1787862407.144124:0:6709:0:(import.c:65:import_set_state_nolock()) ffff89a13d573000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787862407.144346:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787862407.144637:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2351:x1874709223415168:12345-192.168.202.9@tcp:9:umount.0 Request processed in 610us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862407.144647:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00080000:3.0:1787862407.144789:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1787862407.145435:0:8521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89a13d571800: total 0 00010000:00010000:2.0:1787862407.145475:0:8521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89a13d571800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787862407.145537:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab0fb8b/0x391a6cd368cdab03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0945 expref: 4 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862407.145585:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cda465 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0777 expref: 3 pid: 12084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862407.145600:0:8521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89a13d571800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787862407.145611:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862407.145614:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862407.145615:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862407.149844:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862407.150034:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223415296 00000100:00100000:2.0:1787862407.150067:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223415296 00000100:00100000:2.0:1787862407.150135:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:2.0:1787862407.150269:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+5:2351:x1874709223415296:12345-192.168.202.9@tcp:9:umount.0 00000020:00000080:2.0:1787862407.150314:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9e61 00000100:00080000:2.0:1787862407.150324:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a13d80c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862407.150371:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1787862407.151729:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787862407.152254:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862407.155059:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+2:2351:x1874709223415296:12345-192.168.202.9@tcp:9:umount.0 Request processed in 4887us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862407.155076:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:3.0:1787862407.173671:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862407.173885:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223416320 00000100:00100000:2.0:1787862407.173897:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223416320 00000100:00100000:2.0:1787862407.173971:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 240 00000100:00100000:2.0:1787862407.173982:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+22:2351:x1874709223416320:12345-192.168.202.9@tcp:39:umount.0 00000020:00000080:2.0:1787862407.174022:0:5870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9afd 00000020:00010000:2.0:1787862407.175010:0:5870:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89a005470000: total 0 00000100:00080000:2.0:1787862407.175017:0:5870:0:(import.c:65:import_set_state_nolock()) ffff89a005474800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787862407.175153:0:5856:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89a005470000: total 0 00010000:00010000:1.0:1787862407.175226:0:5856:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89a005470000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787862407.175271:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862407.175275:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862407.175287:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8600/0x391a6cd368cdaac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0930 expref: 21 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175308:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862407.175310:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787862407.175315:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a100030c00/0x391a6cd368cdaaee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c093e expref: 20 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175328:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862407.175331:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862407.175335:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f000/0x391a6cd368cda426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0762 expref: 19 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175347:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862407.175349:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787862407.175353:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ee00/0x391a6cd368cda450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0770 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175365:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862407.175368:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862407.175373:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2ce00/0x391a6cd368cda7c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c086c expref: 17 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175384:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862407.175387:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862407.175405:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a8200/0x391a6cd368cda124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c069e expref: 16 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175419:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89a116882c00) 00010000:00010000:1.0:1787862407.175421:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862407.175425:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160a00/0x391a6cd368cd9dc7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05b0 expref: 15 pid: 9468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175443:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862407.175445:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787862407.175449:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79e400/0x391a6cd368cda4e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c079a expref: 14 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175462:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89a116882300) 00010000:00010000:1.0:1787862407.175465:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862407.175469:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a142160200/0x391a6cd368cda346 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c072a expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175483:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89a104fc5900) 00010000:00010000:1.0:1787862407.175486:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787862407.175489:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a1206a9600/0x391a6cd368cd9e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05cc expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175502:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89a104fc5b00) 00010000:00010000:1.0:1787862407.175504:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862407.175809:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f600/0x391a6cd368cda9e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c08f8 expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175834:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:1.0:1787862407.175844:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862407.175849:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c800/0x391a6cd368cda4c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0793 expref: 10 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175864:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a108824e00) 00010000:00010000:1.0:1787862407.175867:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862407.175871:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cd9de3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c05b7 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862407.175885:0:5856:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89a005470000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787862407.175899:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862407.175915:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862407.175918:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787862407.176860:0:5870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1787862407.177879:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20d7abe-3b31-4da4-909a-c5bb95bfc247+7:2351:x1874709223416320:12345-192.168.202.9@tcp:39:umount.0 Request processed in 3891us (4213us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787862407.177893:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 240 00010000:00010000:2.0:1787862407.300449:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862407.520075:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862407.520122:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862407.520409:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223416448 00000100:00100000:2.0:1787862407.520419:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223416448 00000100:00100000:2.0:1787862407.520495:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 314 00000100:00100000:2.0:1787862407.520505:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223416448:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862407.520607:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223416448:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 102us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862407.520616:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 314 00000100:00100000:3.0:1787862407.521406:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223416576 00000100:00100000:3.0:1787862407.521414:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223416576 00000100:00100000:3.0:1787862407.521488:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 201 00000100:00100000:3.0:1787862407.521497:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2353:x1874709223416576:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862407.521567:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2353:x1874709223416576:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 71us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862407.521574:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 201 00000100:00080000:2.0:1787862407.522578:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862408.197190:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246469248:0@lo:400:kworker.0 00000100:00100000:3.0:1787862408.197300:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862408.197394:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862408.197422:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c100b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246469120:0@lo:400:kworker.0 00000100:00100000:3.0:1787862408.197453:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862408.197494:0:12084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469248 00000100:00100000:3.0:1787862408.197503:0:12084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469248 00000100:00100000:0.0:1787862408.197690:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469120 00000100:00100000:0.0:1787862408.197695:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469120 00000100:00100000:0.0:1787862408.197746:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787862408.197756:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246469120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862408.197829:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246469120:12345-0@lo:400:kworker.0 Request processed in 75us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862408.197837:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787862408.197887:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c100b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246469120:0@lo:400:kworker.0 00000100:00100000:3.0:1787862408.198136:0:12084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787862408.198146:0:12084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246469248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862408.198188:0:12084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246469248:12345-0@lo:400:kworker.0 Request processed in 44us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862408.198196:0:12084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787862408.198281:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246468992:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.198316:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862408.198345:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c102580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246469504:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.198371:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862408.198399:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862408.198406:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246468864:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.198435:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862408.198457:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246469376:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.198479:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787862408.198507:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862408.198512:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862408.198527:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469504 00000100:00100000:2.0:1787862408.198532:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469504 00000100:00100000:2.0:1787862408.198585:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787862408.198591:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246469504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.198630:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246469504:12345-0@lo:400:kworker.0 Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862408.198652:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787862408.198826:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468864 00000100:00100000:2.0:1787862408.198831:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468864 00000100:00100000:2.0:1787862408.198861:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787862408.198867:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246468864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.198915:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3328:x1874709246468864:12345-0@lo:400:kworker.0 Request processed in 47us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862408.198922:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787862408.198963:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246468992 00000100:00100000:2.0:1787862408.198967:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246468992 00000100:00100000:2.0:1787862408.198996:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469376 00000100:00100000:2.0:1787862408.198999:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469376 00000100:00100000:2.0:1787862408.199023:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787862408.199030:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246468992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.199102:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246468992:12345-0@lo:400:kworker.0 Request processed in 73us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862408.199109:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787862408.199120:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787862408.199125:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246469376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.199152:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3328:x1874709246469376:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862408.199158:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1787862408.199179:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862408.199182:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862408.199214:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246468864:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.199228:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3328:1874709246469376:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.199249:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246468992:0@lo:400:kworker.0 00000100:00100000:2.0:1787862408.199261:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c102580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246469504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862408.200087:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246469248:0@lo:400:kworker.0 00010000:00010000:0.0:1787862408.328380:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862408.708665:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246469632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862408.708776:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862408.709608:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469632 00000100:00100000:0.0:1787862408.709619:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469632 00000100:00100000:0.0:1787862408.709683:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787862408.709696:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246469632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862408.709748:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862408.709825:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246469632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862408.709833:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787862408.709915:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246469632:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787862408.804794:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1787862408.804829:0:5890:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000001:00080000:2.0:1787862408.804837:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787862408.804841:0:5890:0:(genops.c:885:class_export_put()) final put ffff89a005470000/c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:3.0:1787862408.804922:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a005470000/c20d7abe-3b31-4da4-909a-c5bb95bfc247 for lustre-MDT0000 00000020:00000080:2.0:1787862408.805641:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a005474800 for lustre-MDT0000 00010000:00010000:1.0:1787862409.352762:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787862409.359436:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:1.0:1787862409.359452:0:6736:0:(genops.c:885:class_export_put()) final put ffff89a13d80f800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:2.0:1787862409.361279:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a13d80f800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 for lustre-OST0000 00000020:00000080:2.0:1787862409.361392:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a13d80c000 for lustre-OST0000 00000001:00100000:2.0:1787862409.378083:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:2.0:1787862409.378098:0:7661:0:(genops.c:885:class_export_put()) final put ffff89a13d571800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 00000020:00000080:1.0:1787862409.378181:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a13d571800/c20d7abe-3b31-4da4-909a-c5bb95bfc247 for lustre-OST0001 00000020:00000080:1.0:1787862409.378259:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a13d573000 for lustre-OST0001 00000100:00100000:3.0:1787862409.384248:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862409.384390:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223416704 00000100:00100000:0.0:1787862409.384403:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223416704 00000100:00100000:0.0:1787862409.384495:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1787862409.384530:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2353:x1874709223416704:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862409.384555:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862409.384584:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79e600/0x391a6cd368cd9bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0516 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862409.384608:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862409.384707:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:2353:x1874709223416704:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 181us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862409.384716:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1787862409.388351:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862409.388414:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862409.388499:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223416832 00000100:00100000:2.0:1787862409.388513:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223416832 00000100:00100000:2.0:1787862409.388598:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223416960 00000100:00100000:2.0:1787862409.388601:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223416960 00000100:00100000:2.0:1787862409.388639:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:2.0:1787862409.388651:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+10:2352:x1874709223416832:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862409.388676:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862409.388703:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a142160000/0x391a6cd368cd9d6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c059b expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862409.388728:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862409.388794:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+9:2352:x1874709223416832:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 145us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862409.388803:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:2.0:1787862409.388824:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1787862409.388852:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+8:2353:x1874709223416960:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862409.388862:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862409.388875:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79fa00/0x391a6cd368cd9bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04ec expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862409.388897:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862409.388920:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+7:2353:x1874709223416960:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 73us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862409.388927:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:3.0:1787862409.421803:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862409.422036:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223417216 00000100:00100000:2.0:1787862409.422106:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223417216 00000100:00100000:2.0:1787862409.422207:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 241 00000100:00100000:2.0:1787862409.422219:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+6:2351:x1874709223417216:12345-192.168.202.9@tcp:39:umount.0 00000020:00000080:2.0:1787862409.422288:0:9468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9be4 00000020:00010000:2.0:1787862409.422300:0:9468:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89a1087e7000: total 0 00000100:00080000:2.0:1787862409.422307:0:9468:0:(import.c:65:import_set_state_nolock()) ffff89a1087e4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862409.422354:0:9468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787862409.422948:0:8521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89a1087e7000: total 0 00000100:00100000:2.0:1787862409.422958:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e4a3c95-44f3-4a05-aca3-5d290a7788c7+5:2351:x1874709223417216:12345-192.168.202.9@tcp:39:umount.0 Request processed in 736us (1167us total) trans 4294967526 rc 0/0 00010000:00010000:1.0:1787862409.422958:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862409.422970:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 241 00010000:00010000:1.0:1787862409.423020:0:8521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89a1087e7000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787862409.423091:0:8521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a108824f00) 00010000:00010000:1.0:1787862409.423113:0:8521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862409.423125:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f800/0x391a6cd368cdab11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c094c expref: 4 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862409.423155:0:8521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89a1087e7000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787862409.423171:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862409.423172:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862409.423174:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787862409.423450:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862409.453323:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862409.453468:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223417472 00000100:00100000:0.0:1787862409.453483:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223417472 00000100:00100000:0.0:1787862409.453568:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 316 00000100:00100000:0.0:1787862409.453580:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+7:2351:x1874709223417472:12345-192.168.202.9@tcp:251:umount.0 00000020:00000080:0.0:1787862409.453663:0:5862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9ada 00000020:00010000:0.0:1787862409.453675:0:5862:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89a0054e0800: total 0 00000100:00080000:0.0:1787862409.453681:0:5862:0:(import.c:65:import_set_state_nolock()) ffff89a0054e3000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787862409.454108:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1111c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7+3:2351:x1874709223417472:12345-192.168.202.9@tcp:251:umount.0 Request processed in 527us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862409.454119:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 316 00000020:00010000:1.0:1787862409.455643:0:5857:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89a0054e0800: total 0 00010000:00010000:0.0:1787862409.455879:0:5857:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89a0054e0800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787862409.455951:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030a00/0x391a6cd368cd9b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c04de expref: 2 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862409.455974:0:5857:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89a0054e0800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787862409.455985:0:5857:0:(genops.c:885:class_export_put()) final put ffff89a0054e0800/4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7 00010000:00010000:0.0:1787862409.456013:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862409.456072:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862409.456075:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787862409.457761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0054e0800/4d8a3f02-e1bd-4c5c-84f1-facea1f0cad7 for MGS 00000020:00000080:1.0:1787862409.457834:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a0054e3000 for MGS 00000040:00080000:3.0:1787862410.249572:0:11754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862410.249584:0:11754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862410.250190:0:11754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787862410.250203:0:11754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787862410.372147:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862411.268527:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862411.268642:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862411.268782:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469760 00000100:00100000:2.0:1787862411.268793:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469760 00000100:00100000:2.0:1787862411.268883:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787862411.268895:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246469760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862411.268944:0:6714:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862411.269006:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246469760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862411.269037:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787862411.269131:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246469760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787862411.269217:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862411.396155:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787862411.630762:0:12988:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787862411.654929:0:12988:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787862411.655017:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.655056:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.655065:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.655074:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.655093:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862411.655117:0:12988:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787862411.655148:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787862411.655154:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787862411.655162:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787862411.655199:0:12988:0:(import.c:65:import_set_state_nolock()) ffff89a13c3c1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787862411.656728:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862411.656745:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.656758:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b210400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862411.656763:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.656775:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862411.656783:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862411.656789:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787862411.656792:0:5857:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787862411.656796:0:5857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787862411.656844:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.656852:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787862411.657954:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246470016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862411.658082:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862411.658231:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470016 00000100:00100000:2.0:1787862411.658242:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470016 00000100:00100000:2.0:1787862411.658399:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862411.658411:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3327:x1874709246470016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862411.658439:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862411.658465:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030800/0x391a6cd368cd9b66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b5f expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862411.658484:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862411.662207:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.662235:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b210400/0x391a6cd368cd9b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b66 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.662270:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862411.662272:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862411.662276:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862411.662339:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246469888:0@lo:39:umount.0 00000100:00100000:0.0:1787862411.662454:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862411.662557:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246469888 00000100:00100000:0.0:1787862411.662568:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246469888 00000100:00100000:0.0:1787862411.662637:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787862411.662648:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874709246469888:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787862411.662684:0:5870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd98f7 00000100:00080000:0.0:1787862411.662696:0:5870:0:(import.c:65:import_set_state_nolock()) ffff89a112be9000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787862411.662768:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3326:x1874709246469888:12345-0@lo:39:umount.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862411.662777:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787862411.662789:0:5870:0:(genops.c:885:class_export_put()) final put ffff89a112bec000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787862411.662813:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787862411.662845:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a13c3c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787862411.662871:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246469888:0@lo:39:umount.0 00000100:00080000:0.0:1787862411.662919:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787862411.662924:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787862411.662929:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787862411.663949:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.663968:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.663976:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.663984:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664032:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862411.664077:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664085:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664092:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664097:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664109:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787862411.664127:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862411.664133:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664140:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862411.664144:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664153:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862411.664160:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862411.664166:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787862411.664175:0:5857:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787862411.664218:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.664226:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1787862411.664631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a112bec000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787862411.664709:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a112be9000 for lustre-MDT0000 00010000:00010000:3.0:1787862411.665111:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665125:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665131:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665137:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665166:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787862411.665174:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665180:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665186:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665191:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862411.665199:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787862411.665203:0:12988:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787862411.665208:0:12988:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787862411.665246:0:12988:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787862411.665252:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787862411.665258:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787862411.665265:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787862411.665274:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff89a0054e7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787862411.665280:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff89a0056f4800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787862411.665288:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff89a1087e7000 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 192.168.202.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787862411.665294:0:12988:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff89a13bb5ced8) has exports, disconnecting them 00000020:00080000:3.0:1787862411.665299:0:12988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a0054e7800), last request at 1787862408 00000020:00000080:3.0:1787862411.665307:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9a5c 00000100:00080000:3.0:1787862411.665325:0:12988:0:(import.c:65:import_set_state_nolock()) ffff89a0054e4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787862411.665380:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a0054e7800): rc 0 00000020:00000080:3.0:1787862411.665383:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a0054e7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787862411.665393:0:12988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a0056f4800), last request at 1787862408 00000020:00000080:3.0:1787862411.665397:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9991 00000100:00080000:3.0:1787862411.665402:0:12988:0:(import.c:65:import_set_state_nolock()) ffff89a0056f3800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787862411.665411:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0054e7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787862411.665444:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a0054e4000 for lustre-MDT0000 00000020:00080000:3.0:1787862411.665456:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a0056f4800): rc 0 00000020:00000080:3.0:1787862411.665459:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a0056f4800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787862411.665474:0:12988:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8d281ccfae0 00000020:00000080:3.0:1787862411.665485:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0056f4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787862411.665598:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a0056f3800 for lustre-MDT0000 00000100:00080000:3.0:1787862411.665631:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787862411.665637:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787862411.665655:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787862411.665729:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787862411.665753:0:12988:0:(import.c:65:import_set_state_nolock()) ffff89a102aa5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787862411.665771:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787862411.665774:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787862411.665782:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787862411.665847:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787862411.665856:0:12988:0:(import.c:65:import_set_state_nolock()) ffff89a141983000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787862411.665897:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff89a13bb5ced8) has no exports 00010000:00010000:1.0:1787862411.666655:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787862411.666668:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666681:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2de00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862411.666686:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666699:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862411.666708:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862411.666715:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862411.666718:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787862411.666721:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787862411.666763:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666769:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862411.666807:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666835:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a104c2de00/0x391a6cd368cd9a94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9a9b expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666858:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862411.666876:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666882:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8c00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862411.666885:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666893:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862411.666900:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862411.666906:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787862411.666908:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787862411.666911:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787862411.666932:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666939:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862411.666945:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666952:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cd9d96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9d9d expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666971:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862411.666976:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666981:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9200 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862411.666984:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.666992:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862411.666999:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862411.667004:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862411.667007:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787862411.667009:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787862411.667023:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.667029:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862411.667036:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.667062:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cd9848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd984f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.667073:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862411.667075:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862411.667084:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862411.667209:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246470656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862411.667313:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862411.667374:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862411.667382:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246470528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862411.667408:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862411.667461:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470656 00000100:00100000:1.0:1787862411.667470:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470656 00000100:00100000:1.0:1787862411.667844:0:8522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470528 00000100:00100000:1.0:1787862411.667849:0:8522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470528 00000100:00100000:1.0:1787862411.667881:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862411.667891:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+20:3330:x1874709246470656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862411.667907:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862411.667925:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a142161600/0x391a6cd368cd9d9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9d96 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.667942:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862411.667981:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+19:3330:x1874709246470656:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862411.667989:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862411.668005:0:8522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862411.668011:0:8522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1129bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:3330:x1874709246470528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862411.668019:0:8522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862411.668027:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030600/0x391a6cd368cd9a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9a94 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862411.668061:0:8522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862411.668082:0:8522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1129bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:3330:x1874709246470528:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862411.668097:0:8522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862411.668139:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246470528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862411.668147:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3330:1874709246470656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862411.668556:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.668565:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100030000/0x391a6cd368cd9b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b74 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.668577:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862411.668579:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862411.668581:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862411.668596:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246470144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862411.668636:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862411.668677:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862411.668684:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246470784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862411.668709:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862411.668733:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862411.668746:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246470272:0@lo:9:umount.0 00000100:00100000:0.0:1787862411.668777:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862411.668801:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246470400:0@lo:9:umount.0 00000100:00100000:0.0:1787862411.668824:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862411.669285:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470144 00000100:00100000:0.0:1787862411.669293:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470144 00000100:00100000:0.0:1787862411.669335:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470784 00000100:00100000:0.0:1787862411.669339:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470784 00000100:00100000:0.0:1787862411.669357:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862411.669365:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+18:3328:x1874709246470144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862411.669389:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862411.669405:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210200/0x391a6cd368cd9b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b6d expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.669417:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862411.669454:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+17:3328:x1874709246470144:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862411.669461:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862411.669477:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862411.669483:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+16:3328:x1874709246470784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862411.669492:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862411.669500:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b211a00/0x391a6cd368cd984f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9848 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862411.669511:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862411.669531:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+15:3328:x1874709246470784:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862411.669537:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862411.669559:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470272 00000100:00100000:0.0:1787862411.669562:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470272 00000100:00100000:0.0:1787862411.669592:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470400 00000100:00100000:0.0:1787862411.669595:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470400 00000100:00100000:0.0:1787862411.669628:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862411.669635:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874709246470272:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787862411.669666:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd99de 00000100:00080000:0.0:1787862411.669678:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a141987000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787862411.669723:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787862411.670183:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3326:x1874709246470272:12345-0@lo:9:umount.0 Request processed in 546us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862411.670200:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862411.670215:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862411.670223:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874709246470400:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787862411.670237:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9ac5 00000100:00080000:0.0:1787862411.670244:0:6712:0:(import.c:65:import_set_state_nolock()) ffff89a0054e4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787862411.670268:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787862411.670475:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3326:x1874709246470400:12345-0@lo:9:umount.0 Request processed in 252us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862411.670482:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862411.670537:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246470784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862411.670549:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246470144:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787862411.670590:0:5864:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862411.670605:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787862411.670626:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a102aa5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787862411.670642:0:3326:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787862411.670645:0:3326:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787862411.670649:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246470272:0@lo:9:umount.0 00000100:00080000:0.0:1787862411.670662:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a141983000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787862411.670671:0:3326:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787862411.670673:0:3326:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787862411.670675:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246470400:0@lo:9:umount.0 00010000:00010000:0.0:1787862411.670709:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862411.675792:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3327:x1874709246470016:12345-0@lo:103:ldlm_bl.0 Request processed in 17364us (17691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862411.675815:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862411.676035:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246470016:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787862411.682606:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff89a13bb5ced8) has no exports 00000020:00000080:0.0:1787862411.795339:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd98a3 00000020:00000080:0.0:1787862411.795356:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a104dfd800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787862411.795438:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787862411.796359:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862411.796373:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787862411.796379:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff89a108760000) has no exports 00000020:00000080:3.0:1787862411.796987:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd989c 00000020:00000080:3.0:1787862411.797005:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a13d89d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787862411.800426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a104dfd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787862411.801277:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a13d89d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787862411.802781:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862411.802802:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787862411.802812:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a13d89c000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787862411.802817:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a13d89c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787862411.802847:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787862412.420692:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862413.317710:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246470912:0@lo:400:kworker.0 00000100:00100000:0.0:1787862413.317797:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862413.318022:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246470912 00000100:00100000:3.0:1787862413.318033:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246470912 00000100:00100000:3.0:1787862413.318123:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787862413.318134:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3328:x1874709246470912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862413.318231:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d85b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246471168:0@lo:400:kworker.0 00000100:00100000:1.0:1787862413.318267:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862413.318291:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862413.318298:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246471040:0@lo:400:kworker.0 00000100:00100000:1.0:1787862413.318320:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862413.320209:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246471168 00000100:00100000:2.0:1787862413.320223:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246471168 00000100:00100000:2.0:1787862413.320280:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246471040 00000100:00100000:2.0:1787862413.320284:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246471040 00000100:00100000:2.0:1787862413.320308:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787862413.320316:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3330:x1874709246471168:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787862413.320326:0:9468:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787862413.320404:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3330:x1874709246471168:12345-0@lo:400:kworker.0 Request processed in 86us (2135us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787862413.320412:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787862413.320447:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787862413.320451:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3330:x1874709246471040:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787862413.320456:0:9468:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787862413.320482:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3330:x1874709246471040:12345-0@lo:400:kworker.0 Request processed in 29us (2160us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787862413.320487:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1787862413.322189:0:3330:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787862413.322197:0:3330:0:(import.c:65:import_set_state_nolock()) ffff89a116a8f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787862413.322202:0:3330:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787862413.350557:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55a8aa20-01eb-4a0c-8ff5-cc227f621b82+14:3328:x1874709246470912:12345-0@lo:400:kworker.0 Request processed in 32411us (32745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862413.350574:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787862413.350793:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3328:1874709246470912:0@lo:400:kworker.0 00000100:00080000:1.0:1787862413.355549:0:3330:0:(import.c:65:import_set_state_nolock()) ffff89a116a8f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862413.355568:0:3330:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 216 00000100:00080000:1.0:1787862413.355580:0:3330:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a116a8f000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862413.355628:0:3330:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a94000 x1874709246471296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862413.355662:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c1a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246471040:0@lo:400:kworker.0 00000100:00080000:1.0:1787862413.355705:0:3330:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787862413.355710:0:3330:0:(import.c:65:import_set_state_nolock()) ffff89a005471800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787862413.355714:0:3330:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787862413.355738:0:3330:0:(import.c:65:import_set_state_nolock()) ffff89a005471800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862413.355742:0:3330:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 239 00000100:00080000:1.0:1787862413.355747:0:3330:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a005471800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862413.355762:0:3330:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a95a40 x1874709246471424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862413.355774:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d85b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246471168:0@lo:400:kworker.0 00000100:00100000:2.0:1787862413.355980:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246471296:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787862413.356067:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862413.356107:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246471424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787862413.356128:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862413.357983:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246471296 00000100:00100000:3.0:1787862413.357996:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246471296 00000100:00100000:3.0:1787862413.358077:0:9468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246471424 00000100:00100000:3.0:1787862413.358081:0:9468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246471424 00000100:00100000:3.0:1787862413.358118:0:9468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787862413.358127:0:9468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d85b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3326:x1874709246471296:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1787862413.358149:0:9468:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787862413.358161:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787862413.358168:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3326:x1874709246471424:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787862413.358176:0:5869:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787862413.358270:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3326:x1874709246471424:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 100us (2139us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787862413.358278:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1787862413.358322:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a005471800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787862413.358328:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787862413.358332:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246471424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787862413.373586:0:9468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d85b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3326:x1874709246471296:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 15453us (17516us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787862413.373601:0:9468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787862413.375437:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a116a8f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787862413.375447:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787862413.375452:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246471296:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1787862413.444676:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787862413.879832:0:5890:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000001:00080000:3.0:1787862413.879862:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787862413.879869:0:5890:0:(genops.c:885:class_export_put()) final put ffff89a1087e7000/8e4a3c95-44f3-4a05-aca3-5d290a7788c7 00000020:00000080:0.0:1787862413.880164:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1087e7000/8e4a3c95-44f3-4a05-aca3-5d290a7788c7 for lustre-MDT0000 00000020:00000080:0.0:1787862413.880394:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a1087e4800 for lustre-MDT0000 00000001:00100000:2.0:1787862414.415693:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787862414.415702:0:7661:0:(genops.c:885:class_export_put()) final put ffff89a0054e3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787862414.417863:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0054e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787862414.417930:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a0054e4800 for lustre-OST0001 00000001:00100000:1.0:1787862414.424257:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787862414.424268:0:6736:0:(genops.c:885:class_export_put()) final put ffff89a141984800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787862414.424336:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a141984800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787862414.424390:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a141987000 for lustre-OST0000 00010000:00010000:0.0:1787862414.468341:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862415.492289:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862416.516572:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862417.542020:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787862417.861349:0:12988:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a13bd9d7e0 - data ffff89a12f44e510/ffff89a13cb30400 00000020:01000000:2.0:1787862417.861893:0:12988:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a107e567e0 - data ffff89a11831da20/ffff89a102aaac00 00000001:00000004:2.0:1787862417.872984:0:12988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787862418.004011:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787862418.004023:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787862418.005929:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787862418.005939:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787862418.015386:0:6912:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787862418.015396:0:6912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787862418.015413:0:6912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787862418.016351:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787862418.016358:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787862418.016373:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787862418.016377:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787862418.016534:0:8121:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787862418.016538:0:8121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787862418.016547:0:8121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787862418.124441:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd986b 00000020:00000080:2.0:1787862418.124455:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a102b41800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787862418.124579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102b41800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787862418.125679:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9880 00000020:00000080:2.0:1787862418.125690:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a111f18800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787862418.125710:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787862418.125716:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.125724:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1787862418.125725:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a111f18800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:2.0:1787862418.125728:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff89a13bb58000) has no exports 00000004:01000000:2.0:1787862418.125894:0:12988:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787862418.125903:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9abe 00000020:00000080:2.0:1787862418.125907:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a11106c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787862418.125920:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787862418.125923:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.125929:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787862418.125931:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff89a111028000) has no exports 00000020:00000080:2.0:1787862418.125937:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9ab7 00000020:00000080:2.0:1787862418.125940:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a006bd3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787862418.126018:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a11106c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787862418.126025:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a006bd3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787862418.126283:0:12988:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787862418.126288:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787862418.126293:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787862418.126299:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787862418.126301:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787862418.126339:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.126345:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862418.126350:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd99d7 00000020:00000080:2.0:1787862418.126361:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a1087e2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787862418.126365:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787862418.126368:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.126372:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787862418.126378:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff89a13f9a3490) has no exports 00000020:00000080:2.0:1787862418.126383:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd99d0 00000020:00000080:2.0:1787862418.126386:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a005952000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787862418.126416:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a141983000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787862418.126423:0:38:0:(genops.c:885:class_export_put()) final put ffff89a006bd6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787862418.126425:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a006bd6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787862418.126429:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787862418.126568:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1087e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787862418.126573:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a005952000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787862418.126705:0:12988:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787862418.126708:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787862418.126711:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787862418.126715:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787862418.126716:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787862418.126753:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.126758:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862418.126785:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.126788:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862418.126791:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a103f93000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787862418.126794:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a103f93000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787862418.126797:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787862418.126826:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a102aa5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787862418.126838:0:38:0:(genops.c:885:class_export_put()) final put ffff89a005953000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787862418.126840:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a005953000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787862418.126846:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862418.126940:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9887 00000020:00000080:2.0:1787862418.126945:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a111f1c800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787862418.126953:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787862418.126961:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.126965:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787862418.126968:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff89a13bb5b490) has no exports 00000020:00000080:2.0:1787862418.126988:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.126992:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787862418.126995:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd988e 00000020:00000080:2.0:1787862418.126999:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a111f1e800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787862418.127011:0:12988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a102b43800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787862418.127015:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a102b43800 3 00000020:01000004:2.0:1787862418.127018:0:12988:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a102b43800 from lustre-MDT0000 00000020:00000080:2.0:1787862418.127063:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.127067:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787862418.127070:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a102b46800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787862418.127073:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102b46800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787862418.127079:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787862418.127107:0:12988:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787862418.127110:0:12988:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787862418.127113:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787862418.127116:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.127119:0:12988:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787862418.127125:0:12988:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff89a103f92000 55a8aa20-01eb-4a0c-8ff5-cc227f621b82 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787862418.127129:0:12988:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff89a108764ed8) has exports, disconnecting them 00000020:00080000:2.0:1787862418.127133:0:12988:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a103f92000), last request at 1787862141 00000020:00000080:2.0:1787862418.127145:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd982c 00000020:00010000:2.0:1787862418.127149:0:12988:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89a103f92000: total 2 00000100:00080000:2.0:1787862418.127153:0:12988:0:(import.c:65:import_set_state_nolock()) ffff89a103f90000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787862418.127174:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a103f92000): rc 0 00000020:00080000:2.0:1787862418.127178:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff89a108764ed8) has no exports 00000020:00010000:3.0:1787862418.127204:0:5856:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89a103f92000: total 2 00010000:00010000:3.0:1787862418.127234:0:5856:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89a103f92000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787862418.127264:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cd9d8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9d88 expref: 9 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127284:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210000/0x391a6cd368cd9944 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd993d expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127297:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a8800/0x391a6cd368cd9b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b7b expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127308:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2c200/0x391a6cd368cd9b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b27 expref: 6 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127318:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100030400/0x391a6cd368cd9b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b35 expref: 5 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127327:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a142160800/0x391a6cd368cd9d7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9d73 expref: 4 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127338:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100031e00/0x391a6cd368cd9b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b43 expref: 3 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127348:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13b210800/0x391a6cd368cd9b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x391a6cd368cd9b51 expref: 2 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.127357:0:5856:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89a103f92000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787862418.127368:0:5856:0:(genops.c:885:class_export_put()) final put ffff89a103f92000/55a8aa20-01eb-4a0c-8ff5-cc227f621b82 00010000:00010000:3.0:1787862418.127376:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862418.127383:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862418.127385:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862418.127582:0:5862:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a119313400:5862] 1 exiting: rc = 0 00000100:00100000:3.0:1787862418.133033:0:5860:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a1110ff400:5860] 0 exiting: rc = 1 00000020:00000080:3.0:1787862418.133413:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a111f1c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787862418.133423:0:38:0:(genops.c:885:class_export_put()) final put ffff89a111f19000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787862418.133426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a111f19000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787862418.133431:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787862418.133833:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a111f1e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787862418.133840:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a103f92000/55a8aa20-01eb-4a0c-8ff5-cc227f621b82 for MGS 00000020:00000080:3.0:1787862418.133891:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a103f90000 for MGS 00000100:00100000:2.0:1787862418.145060:0:5863:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a11117e400:5863] 2 exiting: rc = 0 00000100:00100000:3.0:1787862418.145479:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145605:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145612:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145618:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145624:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145629:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145635:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145714:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145723:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145731:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145738:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145744:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145750:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145756:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145762:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145768:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145774:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145780:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145784:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145789:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145796:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145813:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145819:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145846:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145852:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145858:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145865:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145870:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145876:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145883:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145889:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145894:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145900:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145906:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145912:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145918:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145923:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145931:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145936:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145945:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145951:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145957:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145964:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145969:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145975:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145981:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145987:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145993:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.145998:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146004:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146010:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146015:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146020:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146025:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146030:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146035:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146605:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146614:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146629:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146635:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146716:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146726:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146731:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.146738:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787862418.147662:0:12988:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787862418.147667:0:12988:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787862418.149533:0:12988:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a112c58300 - data ffff89a12f7d25e8/ffff89a11032b000 00000020:01000000:3.0:1787862418.149782:0:12988:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a102bc85a0 - data ffff89a1020c7bd0/ffff89a111181800 00000020:00000080:3.0:1787862418.150432:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9810 00000020:00000080:3.0:1787862418.150442:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a102b47000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787862418.150459:0:12988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a102b43800 from MGS, refs=2 00000020:01000004:3.0:1787862418.150463:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a102b43800 2 00000020:01000004:3.0:1787862418.150466:0:12988:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a102b43800 from MGS 00000020:00000080:3.0:1787862418.150741:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862418.150750:0:12988:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787862418.150754:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a102b41000/MGS 00000020:00000080:3.0:1787862418.150757:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102b41000/MGS for MGS 00000020:01000000:3.0:1787862418.150764:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787862418.150835:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787862418.150840:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787862418.150846:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787862418.150853:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a13c3c3800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787862418.150859:0:12988:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff89a13f9a4ed8) has exports, disconnecting them 00000020:00080000:3.0:1787862418.150863:0:12988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a13c3c3800), last request at 1787862142 00000020:00000080:3.0:1787862418.150867:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd98db 00000020:00080000:3.0:1787862418.150874:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a13c3c3800): rc 0 00000020:00000080:3.0:1787862418.150878:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a13c3c3800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787862418.151322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102b47000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787862418.151340:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a13c3c3800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787862418.152955:0:12988:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787862418.152963:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787862418.152968:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787862418.152985:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787862418.153602:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a13c3c1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787862418.153604:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.153612:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787862418.153619:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a112bee000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787862418.153622:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a112bee000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787862418.153632:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787862418.153692:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a102b43800 1 00000020:00000080:2.0:1787862418.153698:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9802 00000020:00000080:2.0:1787862418.153704:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a102b45800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787862418.153718:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787862418.153722:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.153726:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787862418.153729:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff89a102b38000) has no exports 00000020:00000080:0.0:1787862418.154377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102b45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787862418.214460:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.214477:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787862418.214556:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a102afa800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787862418.214562:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102afa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787862418.214571:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787862418.214707:0:12988:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a102b47800 00000020:01000000:2.0:1787862418.214730:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787862418.214734:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862418.214739:0:12988:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787862418.214743:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff89a108761a48) has no exports 00000100:00100000:2.0:1787862418.214835:0:5869:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff89a112b96a00:5869] 1 exiting: rc = 0 00000100:00100000:2.0:1787862418.214944:0:5870:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff89a112b7fa00:5870] 2 exiting: rc = 0 00000100:00100000:2.0:1787862418.215011:0:9468:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff89a13d3a7c00:9468] 3 exiting: rc = 0 00000100:00100000:1.0:1787862418.217275:0:5868:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff89a1103aa600:5868] 0 exiting: rc = 1 00000100:00100000:2.0:1787862418.218587:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218596:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218602:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218608:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218613:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218619:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218625:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218630:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218634:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218640:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218645:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218652:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218657:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218661:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218667:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218673:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218678:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218684:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218689:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218695:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218701:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218718:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218723:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218728:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218733:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218739:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218744:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218750:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218756:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218761:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218766:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218771:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218775:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218780:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218787:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218792:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218797:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218813:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218818:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218824:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218829:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218835:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218840:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218845:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218850:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218855:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218873:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218879:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218884:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218891:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218896:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218902:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218907:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218912:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218918:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218922:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218933:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218939:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218945:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218952:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218956:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218961:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218967:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.218972:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.223682:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89a112b3b800:5872] 1 exiting: rc = 0 00000100:00100000:1.0:1787862418.223880:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89a112b3ba00:5871] 0 exiting: rc = 1 00000100:00100000:2.0:1787862418.224202:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224211:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224217:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224223:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224229:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224234:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224239:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224245:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224251:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224258:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224265:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224273:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224279:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224284:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224290:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224295:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224300:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224306:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224311:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224316:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224322:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224326:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224331:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224335:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224341:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224347:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224352:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224376:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224380:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224386:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224392:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224397:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224401:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224406:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224413:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224418:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224426:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224432:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224437:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224442:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224448:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224455:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224460:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224465:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224470:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224475:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224480:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224485:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224489:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224493:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224498:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224503:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224507:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224511:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224516:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224520:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224526:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224531:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224536:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224540:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224545:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224550:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224563:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.224568:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225081:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89a112b3a600:5874] 1 exiting: rc = 0 00000100:00100000:0.0:1787862418.225380:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff89a112b49600:5873] 0 exiting: rc = 1 00000100:00100000:2.0:1787862418.225466:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225474:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225480:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225487:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225493:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225499:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225505:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225510:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225527:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225533:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225539:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225547:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225553:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225558:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225564:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225570:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225576:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225582:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225588:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225594:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225615:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225622:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225627:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225633:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225638:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225652:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225660:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225666:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225672:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225677:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225683:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225688:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225702:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225707:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225714:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225734:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225741:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225747:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225753:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225760:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225766:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225773:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225780:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225787:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225793:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225808:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225815:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225834:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225842:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225848:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225854:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225860:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225867:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225872:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225878:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225884:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225890:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225895:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225901:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225918:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225925:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225930:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225943:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.225949:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.242829:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89a112b3b400:5875] 0 exiting: rc = 1 00000100:00100000:2.0:1787862418.246395:0:5876:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89a112b3ae00:5876] 1 exiting: rc = 0 00000100:00100000:3.0:1787862418.246534:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246541:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246546:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246551:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246555:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246561:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246566:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246571:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246576:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246580:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246585:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246590:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246595:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246601:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246606:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246612:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246617:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246622:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246627:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246631:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246636:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246810:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246818:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246823:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246827:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246832:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246837:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246841:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246845:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246849:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246854:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246858:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246862:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246867:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246885:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246890:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246894:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246898:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246903:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246907:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246912:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246916:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246921:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246925:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246929:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246934:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246938:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246943:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246947:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246951:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246956:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246960:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246964:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246969:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246973:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246978:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246983:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246990:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.246995:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.247005:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.247010:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.247015:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.247019:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.247024:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.247850:0:5877:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89a112b3bc00:5877] 0 exiting: rc = 1 00000100:00100000:0.0:1787862418.247945:0:5878:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89a112b3a400:5878] 1 exiting: rc = 0 00000100:00100000:2.0:1787862418.248268:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248277:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248290:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248294:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248299:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248305:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248310:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248315:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248320:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248325:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248330:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248335:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248340:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248345:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248350:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248356:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248361:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248366:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248371:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248376:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248380:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248385:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248390:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248394:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248399:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248403:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248408:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248412:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248417:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248421:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248426:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248430:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248435:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248440:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248444:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248449:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248453:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248466:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248471:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248475:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248481:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248485:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248490:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248495:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248500:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248505:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248510:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248515:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248520:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248524:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248529:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248533:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248538:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248543:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248548:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248557:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248564:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248569:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248574:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248578:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248583:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248588:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248592:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.248597:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787862418.249366:0:5879:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff89a112b3ac00:5879] 0 exiting: rc = 1 00000100:00100000:3.0:1787862418.249455:0:5880:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff89a112b3a200:5880] 1 exiting: rc = 0 00000100:00100000:0.0:1787862418.249550:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249558:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249563:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249568:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249573:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249578:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249583:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249588:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249592:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249598:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249603:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249609:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249614:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249620:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249625:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249629:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249634:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249744:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249753:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249766:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249771:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249775:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249780:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249784:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249789:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249794:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249807:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249813:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249818:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249822:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249827:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249832:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249836:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249841:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249845:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249851:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249855:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249859:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249864:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249868:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249873:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249878:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249883:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249887:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249891:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249896:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249900:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249905:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249909:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249914:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249919:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249924:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249928:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249933:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249948:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249952:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249957:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.249961:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.250003:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.250008:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.250013:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.250017:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.250022:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862418.250026:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.251558:0:5881:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff89a112b3b000:5881] 0 exiting: rc = 1 00000100:00100000:2.0:1787862418.251761:0:5882:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff89a112b3a000:5882] 1 exiting: rc = 0 00000100:00100000:0.0:1787862418.252263:0:5883:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff89a112bfe200:5883] 2 exiting: rc = 0 00000100:00100000:3.0:1787862418.252351:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252359:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252381:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252389:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252394:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252422:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252428:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252434:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252439:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252445:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252450:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252456:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252462:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252467:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252474:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252479:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252485:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252490:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252496:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252502:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252508:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252529:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252535:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252540:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252548:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252553:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252558:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252563:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252569:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252589:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252595:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252601:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252607:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252614:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252620:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252738:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252746:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252758:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252764:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252770:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252774:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252781:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252787:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252792:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252807:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252813:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252819:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252825:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252829:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252834:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252840:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252845:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252850:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252869:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252875:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252880:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252886:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252892:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252898:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252908:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252916:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252922:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252927:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862418.252942:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787862418.258838:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862418.258854:0:12988:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787862418.258861:0:12988:0:(genops.c:885:class_export_put()) final put ffff89a112b8a800/MDS_uuid 00000020:00000080:2.0:1787862418.258866:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff89a112b8a800/MDS_uuid for MDS 00000020:01000000:2.0:1787862418.258873:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787862418.259027:0:12988:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:3.0:1787862418.439428:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787862418.439437:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787862418.439442:0:38:0:(import.c:65:import_set_state_nolock()) ffff89a116a8f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862418.439452:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1787862418.439459:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787862418.439468:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a116a8f000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862418.439512:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8c3c0 x1874709246471680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787862418.439533:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787862418.439537:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787862418.439538:0:38:0:(import.c:65:import_set_state_nolock()) ffff89a005471800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862418.439541:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1787862418.439544:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787862418.439548:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a005471800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862418.439558:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8c000 x1874709246471808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862418.439597:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246471552:0@lo:400:kworker.0 00000400:00000100:3.0:1787862418.440353:0:3327:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874709246471552 offset 0 length 224: 4 00000100:00100000:3.0:1787862418.440455:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246471680:0@lo:38:kworker.0 00000400:00000100:3.0:1787862418.440489:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874709246471680 offset 0 length 520: 4 00000100:00100000:3.0:1787862418.440503:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246471808:0@lo:38:kworker.0 00000400:00000100:3.0:1787862418.440518:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874709246471808 offset 0 length 520: 4 00010000:00010000:1.0:1787862418.565244:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862419.588341:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862420.612719:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862421.636503:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787862421.640520:0:13140:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787862421.652199:0:13140:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787862421.652249:0:13140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.652265:0:13140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.652274:0:13140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.652282:0:13140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.652304:0:13140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862421.652309:0:13140:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787862421.652332:0:13140:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787862421.652357:0:13140:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8c3c0 x1874709246471680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787862433 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862421.652375:0:13140:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787862421.652382:0:13140:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787862421.652388:0:13140:0:(import.c:65:import_set_state_nolock()) ffff89a116a8f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787862421.652394:0:13140:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787862421.652398:0:13140:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8c3c0 x1874709246471680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787862433 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862421.652405:0:13140:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787862421.652408:0:13140:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:0.0:1787862421.652486:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862421.652494:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862421.652502:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9c00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862421.652506:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862421.652515:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862421.652523:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862421.652528:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787862421.652531:0:5857:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787862421.652534:0:5857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787862421.652581:0:5857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862421.652598:0:5857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862421.652636:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862421.652643:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9c00/0x391a6cd368cd9b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b4a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862421.652655:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862421.652656:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862421.652658:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862421.652738:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862421.652754:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246471936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862421.652838:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862421.653016:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246471936 00000100:00100000:0.0:1787862421.653024:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246471936 00000100:00100000:0.0:1787862421.653088:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862421.653095:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3327:x1874709246471936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787862421.653102:0:5853:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787862421 with bad export cookie 4114720864808572972 00000100:00100000:3.0:1787862421.657851:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246471680:0@lo:38:kworker.0 00010000:00010000:1.0:1787862421.658821:0:13140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658838:0:13140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658846:0:13140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658853:0:13140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658876:0:13140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862421.658884:0:13140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658890:0:13140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658897:0:13140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658917:0:13140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862421.658930:0:13140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787862421.658935:0:13140:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787862421.658957:0:13140:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787862421.658962:0:13140:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787862421.658968:0:13140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787862421.658974:0:13140:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787862421.658978:0:13140:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff89a11102b490) has no exports 00000020:00080000:1.0:1787862421.659206:0:13140:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff89a11102b490) has no exports 00010000:00010000:3.0:1787862421.660967:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862421.660981:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.660991:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862421.660995:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661035:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862421.661057:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862421.661062:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787862421.661065:0:5856:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787862421.661067:0:5856:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787862421.661108:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661113:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862421.661139:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661146:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031000/0x391a6cd368cd9b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9b58 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661161:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862421.661165:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661172:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862421.661174:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661180:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862421.661196:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862421.661200:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787862421.661203:0:5856:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787862421.661205:0:5856:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787862421.661218:0:5856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661224:0:5856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862421.661231:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661237:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a104c2d400/0x391a6cd368cd9d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x391a6cd368cd9d8f expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862421.661246:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862421.661248:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862421.661250:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862421.661268:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246472064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862421.661332:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862421.661382:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862421.661388:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246472192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862421.661411:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862421.661453:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472064 00000100:00100000:3.0:1787862421.661460:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472064 00000100:00100000:3.0:1787862421.661491:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472192 00000100:00100000:3.0:1787862421.661493:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472192 00000100:00100000:3.0:1787862421.661505:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862421.661518:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3329:x1874709246472064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787862421.661524:0:5855:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787862421 with bad export cookie 4114720864808572972 00000100:00100000:3.0:1787862421.661569:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3329:x1874709246472064:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787862421.661575:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862421.661591:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862421.661595:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3329:x1874709246472192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787862421.661598:0:5855:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787862421 with bad export cookie 4114720864808572972 00000100:00100000:3.0:1787862421.661620:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3329:x1874709246472192:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (209us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787862421.661626:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787862421.661652:0:3329:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787862421.661657:0:3329:0:(import.c:65:import_set_state_nolock()) ffff89a112b8e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787862421.661660:0:3329:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787862421.661851:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787862421.662272:0:13140:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a107e540c0 - data ffff89a131796bd0/ffff89a006e90000 00000020:01000000:1.0:1787862421.662423:0:13140:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a13bdb68a0 - data ffff89a12f6e1bd0/ffff89a0056eb800 00000100:00100000:0.0:1787862421.664675:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3327:x1874709246471936:12345-0@lo:103:ldlm_bl.0 Request processed in 11575us (11832us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787862421.664689:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787862421.664844:0:3327:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787862421.683182:0:3329:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.109@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787862421.683188:0:3329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787862421.683198:0:3329:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8f0c0 x1874709246471552/t0(0) o400->MGC192.168.202.109@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787862434 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862421.683212:0:3329:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a005bcf840 x1874709246471936/t0(0) o103->MGC192.168.202.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787862437 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862421.683221:0:3329:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8c3c0 x1874709246472064/t0(0) o103->MGC192.168.202.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787862437 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862421.683229:0:3329:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8c780 x1874709246472192/t0(0) o103->MGC192.168.202.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787862437 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787862421.683238:0:3329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787862421.683242:0:3329:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787862421.683243:0:3329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787862421.683511:0:3327:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a112b8e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787862421.683541:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246471552:0@lo:400:kworker.0 00000100:00100000:2.0:1787862421.683577:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3327:1874709246471936:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787862421.683626:0:3329:0:(import.c:65:import_set_state_nolock()) ffff89a112b8e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862421.683632:0:3329:0:(import.c:510:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 192 00000100:00080000:3.0:1787862421.683642:0:3329:0:(import.c:624:import_select_connection()) MGC192.168.202.109@tcp: import ffff89a112b8e800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1787862421.684286:0:3329:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13d0bb480 x1874709246472320/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862421.684322:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246472064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862421.684337:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3329:1874709246472192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862421.687684:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3326:1874709246472320:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787862421.687749:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874709246472320 offset 0 length 520: 4 00100000:10000000:0.0:1787862421.696641:0:13140:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787862421.738377:0:13140:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9960 00000020:00000080:0.0:1787862421.738388:0:13140:0:(genops.c:885:class_export_put()) final put ffff89a0056f5000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787862421.738422:0:13140:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a1102e9000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787862421.738426:0:13140:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a1102e9000 2 00000020:01000004:0.0:1787862421.738430:0:13140:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a1102e9000 from lustre-OST0000 00000020:00000080:0.0:1787862421.738455:0:13140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862421.738464:0:13140:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787862421.738467:0:13140:0:(genops.c:885:class_export_put()) final put ffff89a0056f6000/lustre-OST0000_UUID 00000020:00000080:0.0:1787862421.738470:0:13140:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0056f6000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787862421.738476:0:13140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787862421.738528:0:13140:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787862421.738533:0:13140:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787862421.738536:0:13140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862421.738541:0:13140:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787862421.738547:0:13140:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89a111c9d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787862421.738554:0:13140:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff89a102b3ced8) has exports, disconnecting them 00000020:00080000:0.0:1787862421.738559:0:13140:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89a111c9d000), last request at 1787862165 00000020:00000080:0.0:1787862421.738565:0:13140:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd998a 00000020:00080000:0.0:1787862421.738575:0:13140:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a111c9d000): rc 0 00000020:00000080:0.0:1787862421.738579:0:13140:0:(genops.c:885:class_export_put()) final put ffff89a111c9d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787862421.739222:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0056f5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787862421.739236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a111c9d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787862421.739475:0:13140:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787862421.739480:0:13140:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787862421.739484:0:13140:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787862421.739489:0:13140:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787862421.739837:0:13140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862421.739845:0:13140:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787862421.739851:0:13140:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a1102e9000 1 00000020:00000080:0.0:1787862421.739855:0:13140:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd991a 00000020:00000080:0.0:1787862421.739861:0:13140:0:(genops.c:885:class_export_put()) final put ffff89a1102ee000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787862421.740092:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a116a8f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787862421.740101:0:37:0:(genops.c:885:class_export_put()) final put ffff89a1087e3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787862421.740103:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1087e3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787862421.740109:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787862421.744126:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1102ee000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787862421.744210:0:13140:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787862421.744221:0:13140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862421.744230:0:13140:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787862421.744235:0:13140:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff89a13bb59a48) has no exports 00000020:00000080:3.0:1787862421.760341:0:13140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862421.760356:0:13140:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787862421.760362:0:13140:0:(genops.c:885:class_export_put()) final put ffff89a1102eb800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787862421.760367:0:13140:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1102eb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787862421.760374:0:13140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787862421.760511:0:13140:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a1102ec000 00000020:02000400:3.0:1787862421.760559:0:13140:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787862422.662154:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862423.562149:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 55a8aa20-01eb-4a0c-8ff5-cc227f621b82->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787862423.562157:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 55a8aa20-01eb-4a0c-8ff5-cc227f621b82->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787862423.562160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787862423.562164:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787862423.684374:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862424.723928:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787862424.922473:0:13291:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787862424.943623:0:13291:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787862424.943712:0:13291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.943726:0:13291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.943732:0:13291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.943750:0:13291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.943777:0:13291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787862424.943782:0:13291:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787862424.943804:0:13291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787862424.943814:0:13291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8c000 x1874709246471808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787862433 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862424.943842:0:13291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787862424.943846:0:13291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787862424.943852:0:13291:0:(import.c:65:import_set_state_nolock()) ffff89a005471800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787862424.943855:0:13291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787862424.943858:0:13291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13cb8c000 x1874709246471808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787862433 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862424.943862:0:13291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787862424.943864:0:13291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:0.0:1787862424.944166:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862424.944174:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.944181:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13b211400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862424.944185:0:5857:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.944203:0:5857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862424.944211:0:5857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862424.944217:0:5857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787862424.944220:0:5857:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787862424.944223:0:5857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787862424.944239:0:5857:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89a112b8e800 00010000:00010000:0.0:1787862424.944242:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.944246:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b211400/0x391a6cd368cd9b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9b2e expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.944256:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862424.944257:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862424.944258:0:5857:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862424.946181:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246471808:0@lo:38:kworker.0 00010000:00010000:3.0:1787862424.950299:0:13291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950320:0:13291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950329:0:13291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950336:0:13291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950460:0:13291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862424.950470:0:13291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950477:0:13291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950482:0:13291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.950503:0:13291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953234:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862424.953250:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953262:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ca00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862424.953267:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953278:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862424.953286:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862424.953310:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787862424.953313:0:5856:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787862424.953329:0:5856:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89a112b8e800 00010000:00010000:2.0:1787862424.953334:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953341:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a104c2ca00/0x391a6cd368cd9b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9b3c expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953357:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862424.953361:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953366:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142161400 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:2.0:1787862424.953369:0:5856:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.953375:0:5856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862424.953381:0:5856:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.953540:0:13291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1787862424.953548:0:13291:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787862424.953553:0:13291:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787862424.953588:0:13291:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787862424.953593:0:13291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787862424.953606:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787862424.953612:0:13291:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787862424.953617:0:13291:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff89a111029a48) has no exports 00000020:00080000:3.0:1787862424.953868:0:13291:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff89a111029a48) has no exports 00010000:00010000:0.0:1787862424.954818:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862424.957166:0:5856:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787862424.957170:0:5856:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787862424.957174:0:5856:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787862424.957196:0:5856:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89a112b8e800 00010000:00010000:2.0:1787862424.957205:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.957238:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a142161400/0x391a6cd368cd9d73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9d7a expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.957261:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862424.957263:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862424.957266:0:5856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787862424.957787:0:13291:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a1031971e0 - data ffff89a12f6d0ca8/ffff89a13d0af000 00000020:01000000:3.0:1787862424.958118:0:13291:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff89a112c58ea0 - data ffff89a12f6b1948/ffff89a005acb000 00100000:10000000:3.0:1787862424.975771:0:13291:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787862425.055869:0:13291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9a2b 00000020:00000080:3.0:1787862425.055880:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a006bd5800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787862425.055936:0:13291:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a102aa4000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787862425.055941:0:13291:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a102aa4000 2 00000020:01000004:3.0:1787862425.055945:0:13291:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a102aa4000 from lustre-OST0001 00000020:00000080:3.0:1787862425.055974:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862425.055985:0:13291:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787862425.055988:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a006bd7000/lustre-OST0001_UUID 00000020:00000080:3.0:1787862425.055991:0:13291:0:(genops.c:844:class_export_destroy()) destroying export ffff89a006bd7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787862425.055998:0:13291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787862425.056193:0:13291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 55a8aa20-01eb-4a0c-8ff5-cc227f621b82->MGS 00010000:00010000:3.0:1787862425.056213:0:13291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862425.056240:0:13291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862425.056247:0:13291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787862425.056250:0:13291:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787862425.056253:0:13291:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787862425.056271:0:13291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89a112b8e800 00010000:00010000:3.0:1787862425.056275:0:13291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cd993d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9944 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862425.056290:0:13291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862425.056296:0:13291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862425.056301:0:13291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787862425.056303:0:13291:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787862425.056305:0:13291:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787862425.056315:0:13291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89a112b8e800 00010000:00010000:3.0:1787862425.056318:0:13291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13b210c00/0x391a6cd368cd9b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x391a6cd368cd9b82 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787862425.056336:0:13291:0:(import.c:65:import_set_state_nolock()) ffff89a112b8e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787862425.056340:0:13291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787862425.056343:0:13291:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787862425.056345:0:13291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787862425.056349:0:13291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787862425.056362:0:13291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a13d0bb480 x1874709246472320/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787862431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787862425.056398:0:13291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787862425.056401:0:13291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1787862425.056542:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:55a8aa20-01eb-4a0c-8ff5-cc227f621b82:3326:1874709246472320:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787862425.056623:0:13291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787862425.056700:0:13291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd981e 00000020:00000080:3.0:1787862425.056707:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a112b8d800/55a8aa20-01eb-4a0c-8ff5-cc227f621b82 00000020:00000080:0.0:1787862425.059561:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a006bd5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787862425.059589:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89a112b8d800/55a8aa20-01eb-4a0c-8ff5-cc227f621b82 for MGC192.168.202.109@tcp 00000020:01000000:3.0:1787862425.059590:0:13291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.109@tcp (flags='') 00000020:00000080:3.0:1787862425.059755:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787862425.059765:0:13291:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.109@tcp: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787862425.059770:0:13291:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff89a108763490) has no exports 10000000:01000000:0.0:1787862425.059957:0:5865:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787862425.060226:0:13291:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.109@tcp: client import never connected 00000100:00080000:3.0:1787862425.060231:0:13291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787862425.060235:0:13291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787862425.060239:0:13291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787862425.060241:0:13291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787862425.060792:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862425.060803:0:13291:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.109@tcp (uuid 55a8aa20-01eb-4a0c-8ff5-cc227f621b82) 00000020:01000000:3.0:1787862425.060810:0:13291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787862425.060814:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787862425.060819:0:13291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787862425.060826:0:13291:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89a0054e1800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787862425.060831:0:13291:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff89a0055b1a48) has exports, disconnecting them 00000020:00080000:3.0:1787862425.060835:0:13291:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89a0054e1800), last request at 1787862188 00000020:00000080:3.0:1787862425.060839:0:13291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd9a55 00000020:00080000:3.0:1787862425.060858:0:13291:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a0054e1800): rc 0 00000020:00000080:3.0:1787862425.060862:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a0054e1800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787862425.062927:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a112b8e800 for MGC192.168.202.109@tcp 00000020:00000080:2.0:1787862425.062947:0:37:0:(genops.c:885:class_export_put()) final put ffff89a112b88000/55a8aa20-01eb-4a0c-8ff5-cc227f621b82 00000020:00000080:2.0:1787862425.062950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a112b88000/55a8aa20-01eb-4a0c-8ff5-cc227f621b82 for MGC192.168.202.109@tcp 00000020:01000000:2.0:1787862425.062965:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.109@tcp (55a8aa20-01eb-4a0c-8ff5-cc227f621b82) 00000020:00000080:2.0:1787862425.066260:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a0054e1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787862425.067106:0:13291:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787862425.067114:0:13291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787862425.067119:0:13291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787862425.067200:0:13291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787862425.067312:0:5857:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1787862425.067511:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89a005471800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787862425.067849:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787862425.068229:0:5856:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787862425.069895:0:5851:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89a10349aa00:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1787862425.070654:0:7650:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff89a0062aa200:7650] 2 exiting: rc = 0 00000100:00100000:2.0:1787862425.071244:0:5852:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff89a11ef33a00:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1787862425.071305:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.071544:0:5854:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff89a11ef33600:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1787862425.071606:0:5853:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff89a102bf9200:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1787862425.071646:0:5855:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff89a11ef33e00:5855] 2 exiting: rc = 0 00000100:00100000:2.0:1787862425.071706:0:8522:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89a0010f4a00:8522] 3 exiting: rc = 0 00000100:00100000:0.0:1787862425.071999:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072007:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072013:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072019:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072024:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072030:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072035:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072058:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072064:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072070:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072076:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072080:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072088:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072094:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072099:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072105:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072112:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072128:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072134:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072139:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072144:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072150:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072155:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072160:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072164:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072169:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072174:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072180:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072184:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072189:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072195:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072200:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072219:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072223:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072228:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072233:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072239:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072244:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072249:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072253:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072258:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072263:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072268:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072273:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072278:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072283:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072289:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072294:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072298:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072303:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072309:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072314:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072322:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072329:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072333:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072337:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072343:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072347:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072352:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072358:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072363:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072368:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072374:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.072380:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787862425.073277:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862425.073289:0:13291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787862425.073295:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a005475000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787862425.073307:0:13291:0:(genops.c:844:class_export_destroy()) destroying export ffff89a005475000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787862425.073313:0:13291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787862425.073357:0:13291:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a102aa4000 1 00000020:00000080:0.0:1787862425.073365:0:13291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x391a6cd368cd99fa 00000020:00000080:0.0:1787862425.073373:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a1087e0800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787862425.073392:0:13291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787862425.073398:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862425.073402:0:13291:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787862425.073406:0:13291:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff89a13f9a1a48) has no exports 00000020:00000080:2.0:1787862425.073467:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89a1087e0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787862425.096023:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862425.096070:0:13291:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787862425.096077:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a102aa4800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787862425.096083:0:13291:0:(genops.c:844:class_export_destroy()) destroying export ffff89a102aa4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787862425.096096:0:13291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787862425.096314:0:13291:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a102aa2000 00000020:01000000:0.0:1787862425.096336:0:13291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787862425.096341:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862425.096345:0:13291:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787862425.096349:0:13291:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff89a11102ced8) has no exports 00000020:00000080:0.0:1787862425.096376:0:13291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862425.096395:0:13291:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787862425.096398:0:13291:0:(genops.c:885:class_export_put()) final put ffff89a13c1f1800/OSS_uuid 00000020:00000080:0.0:1787862425.096401:0:13291:0:(genops.c:844:class_export_destroy()) destroying export ffff89a13c1f1800/OSS_uuid for OSS 00000020:01000000:0.0:1787862425.096405:0:13291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787862425.096432:0:5864:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787862425.096618:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff89a1129f6200:6712] 2 exiting: rc = 0 00000100:00100000:0.0:1787862425.096669:0:12084:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff89a104c22200:12084] 4 exiting: rc = 0 00000100:00100000:0.0:1787862425.096717:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff89a1129f6000:6711] 1 exiting: rc = 0 00000100:00100000:0.0:1787862425.096778:0:9223:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff89a13d3a6400:9223] 3 exiting: rc = 0 00000100:00100000:1.0:1787862425.096864:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff89a1034ad600:6709] 0 exiting: rc = 1 00000100:00100000:0.0:1787862425.097865:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097875:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097884:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097905:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097910:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097915:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097921:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097927:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097933:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097939:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097946:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097952:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097957:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097962:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097968:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097972:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097977:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097982:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097988:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.097994:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098000:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098005:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098011:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098018:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098023:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098029:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098036:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098058:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098064:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098070:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098076:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098081:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098087:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098091:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098096:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098102:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098109:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098115:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098129:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098135:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098141:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098146:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098152:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098159:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098164:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098169:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098174:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098180:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098186:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098192:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098197:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098204:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098209:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098214:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098219:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098225:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098229:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098234:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098239:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098244:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098250:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098255:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098259:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.098264:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.099239:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89a1129f6c00:6713] 0 exiting: rc = 1 00000100:00100000:2.0:1787862425.113270:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89a1129f7a00:6714] 1 exiting: rc = 0 00000100:00100000:0.0:1787862425.113625:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113646:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113653:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113659:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113664:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113670:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113676:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113681:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113701:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113706:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113712:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113717:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113723:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113728:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113744:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113750:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113755:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113760:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113766:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113772:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113777:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113782:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113788:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113794:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113800:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113806:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113813:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113819:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113825:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113830:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113836:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113842:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113849:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113854:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113861:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113866:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113872:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113878:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113883:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113888:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113894:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113899:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113904:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113917:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113923:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113927:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113933:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113938:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113943:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113947:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113953:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113959:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113963:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113968:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113973:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113978:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113983:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113988:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113994:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.113998:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.114003:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.114008:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.114014:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.114019:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.115205:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89a11119b000:6715] 0 exiting: rc = 1 00000100:00100000:0.0:1787862425.115492:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89a13d646400:6716] 1 exiting: rc = 0 00000100:00100000:2.0:1787862425.116522:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89a13d647600:6717] 2 exiting: rc = 0 00000100:00100000:0.0:1787862425.117572:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117582:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117588:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117605:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117777:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117788:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117794:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117800:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117806:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117812:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117819:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117836:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117853:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117859:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117864:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117869:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117875:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117880:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117887:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117893:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117899:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117906:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117910:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117915:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117921:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117925:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117930:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117935:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117941:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117946:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117951:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117956:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117961:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117966:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117972:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117991:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.117998:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118004:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118008:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118014:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118020:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118025:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118030:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118035:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118070:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118076:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118081:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118093:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118098:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118103:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118108:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118129:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118135:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118142:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118147:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118153:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118159:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118165:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118171:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118192:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118199:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118205:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118209:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.118215:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131069:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89a1418e5600:6719] 1 exiting: rc = 0 00000100:00100000:2.0:1787862425.131527:0:6718:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89a116921800:6718] 0 exiting: rc = 1 00000100:00100000:0.0:1787862425.131841:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131850:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131856:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131862:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131868:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131873:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131878:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131884:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131890:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131895:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131901:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131906:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131911:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131917:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131922:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131927:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131933:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131956:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131962:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131967:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131972:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131978:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131983:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131988:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131994:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.131999:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132004:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132010:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132015:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132020:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132026:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132031:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132036:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132062:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132068:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132073:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132077:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132083:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132088:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132142:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132149:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132155:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132160:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132165:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132170:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132175:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132179:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132184:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132189:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132198:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132205:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132210:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132221:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132226:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132231:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132241:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132250:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132261:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132267:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132271:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132275:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132279:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132283:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.132288:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133018:0:6721:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89a1418e5e00:6721] 1 exiting: rc = 0 00000100:00100000:2.0:1787862425.133106:0:6720:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89a1102ae400:6720] 0 exiting: rc = 1 00000100:00100000:0.0:1787862425.133375:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133383:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133388:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133395:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133400:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133407:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133413:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133474:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133482:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133488:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133495:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133502:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133508:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133514:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133520:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133527:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133533:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133539:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133545:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133565:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133571:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133577:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133592:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133598:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133605:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133612:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133618:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133625:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133632:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133637:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133643:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133664:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133670:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133677:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133683:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133689:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133695:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133701:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133708:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133713:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133720:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133727:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133745:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133768:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133782:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133791:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133799:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133804:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133810:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133816:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133821:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133827:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133832:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133839:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133844:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133862:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133869:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133883:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133888:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133900:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133906:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133912:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133918:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862425.133925:0:13291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787862425.156358:0:13291:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787862443.377304:0:13904:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787862453.926555:0:14365:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787862453.926562:0:14365:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787862453.926706:0:14365:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89a104df9800 00000020:01000004:3.0:1787862453.926733:0:14365:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787862453.926741:0:14365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787862453.926790:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a102b3b490) 00000020:00000080:3.0:1787862453.926804:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787862453.948081:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787862453.955916:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787862453.957934:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 665: rc = 0 00100000:10000000:3.0:1787862453.958204:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 665: rc = 0 00100000:10000000:3.0:1787862453.958412:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787862453.958867:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 665: rc = 0 00100000:10000000:3.0:1787862453.958986:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 665: rc = 0 00100000:10000000:3.0:1787862453.959122:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 665: rc = 0 00100000:10000000:3.0:1787862453.959227:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 665: rc = 0 00100000:10000000:3.0:1787862453.960147:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 667: rc = 0 00100000:10000000:3.0:1787862453.962728:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 4: rc = 0 00100000:10000000:3.0:1787862453.962838:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 4: rc = 0 00100000:10000000:3.0:1787862453.963378:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 5: rc = 0 00100000:10000000:3.0:1787862453.969245:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 5: rc = 0 00100000:10000000:2.0:1787862453.974386:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 5: rc = 0 00100000:10000000:2.0:1787862453.975138:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 5: rc = 0 00100000:10000000:2.0:1787862453.975514:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 5: rc = 0 00100000:10000000:2.0:1787862453.975791:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 5: rc = 0 00100000:10000000:2.0:1787862453.978645:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 5: rc = 0 00100000:10000000:2.0:1787862453.981514:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 5: rc = 0 00100000:10000000:2.0:1787862453.981843:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 5: rc = 0 00100000:10000000:2.0:1787862453.986304:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 5: rc = 0 00100000:10000000:2.0:1787862453.990285:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 5: rc = 0 00100000:10000000:2.0:1787862453.990630:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 5: rc = 0 00100000:10000000:2.0:1787862453.994412:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 560: rc = 0 00100000:10000000:2.0:1787862453.994782:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 560: rc = 0 00100000:10000000:2.0:1787862453.995761:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 560: rc = 0 00100000:10000000:2.0:1787862453.996340:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 560: rc = 0 00100000:10000000:2.0:1787862453.996800:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 560: rc = 0 00100000:10000000:2.0:1787862453.997259:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 560: rc = 0 00100000:10000000:2.0:1787862453.997543:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 560: rc = 0 00100000:10000000:2.0:1787862453.997807:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 560: rc = 0 00100000:10000000:2.0:1787862453.998532:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 560: rc = 0 00100000:10000000:2.0:1787862453.998839:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 560: rc = 0 00100000:10000000:3.0:1787862454.007530:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 560: rc = 0 00100000:10000000:3.0:1787862454.008341:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 560: rc = 0 00100000:10000000:3.0:1787862454.008735:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 560: rc = 0 00100000:10000000:3.0:1787862454.009596:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 560: rc = 0 00100000:10000000:3.0:1787862454.010337:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 560: rc = 0 00100000:10000000:3.0:1787862454.010694:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 560: rc = 0 00100000:10000000:3.0:1787862454.011572:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 560: rc = 0 00100000:10000000:3.0:1787862454.012372:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 560: rc = 0 00100000:10000000:3.0:1787862454.012764:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 560: rc = 0 00100000:10000000:3.0:1787862454.013766:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 560: rc = 0 00100000:10000000:3.0:1787862454.014593:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 560: rc = 0 00100000:10000000:3.0:1787862454.017209:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 560: rc = 0 00100000:10000000:3.0:1787862454.018879:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 560: rc = 0 00100000:10000000:3.0:1787862454.019310:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 560: rc = 0 00100000:10000000:3.0:1787862454.019607:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 560: rc = 0 00100000:10000000:3.0:1787862454.019906:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 560: rc = 0 00100000:10000000:3.0:1787862454.020196:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 560: rc = 0 00100000:10000000:3.0:1787862454.020443:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 560: rc = 0 00100000:10000000:3.0:1787862454.020696:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 560: rc = 0 00100000:10000000:3.0:1787862454.020977:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 560: rc = 0 00100000:10000000:3.0:1787862454.021287:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 560: rc = 0 00100000:10000000:3.0:1787862454.021572:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 560: rc = 0 00100000:10000000:3.0:1787862454.021992:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 13: rc = 0 00100000:10000000:3.0:1787862454.026737:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787862454.027534:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:3.0:1787862454.028351:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787862454.028728:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 776: rc = 0 00100000:10000000:3.0:1787862454.029539:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787862454.029625:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:3.0:1787862454.030975:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787862454.031330:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 423: rc = 0 00100000:10000000:3.0:1787862454.031627:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787862454.031686:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 423: rc = 0 00100000:10000000:3.0:1787862454.032369:0:14365:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787862454.036398:0:14365:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 423: rc = 0 00000020:00000080:2.0:1787862454.038185:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787862454.038196:0:14365:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787862454.038209:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdab1f 00000020:01000004:2.0:1787862454.038219:0:14365:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787862454.038224:0:14365:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787862454.038230:0:14365:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a104df9800 from MGS 00000020:01000004:2.0:1787862454.038234:0:14365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787862454.038247:0:14365:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a11102ced8) 00000020:00000080:2.0:1787862454.038258:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787862454.048867:0:14365:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a104df9800 from MGS, refs=2 00080000:01000000:2.0:1787862454.048899:0:14365:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787862454.048914:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdab2d 00000100:00100000:2.0:1787862454.049102:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787862454.049253:0:14365:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787862454.049260:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787862454.060569:0:14365:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787862454.060591:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787862454.063567:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787862454.063956:0:14365:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787862454.063969:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787862454.076132:0:14365:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787862454.076148:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787862454.077368:0:14365:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787862454.077379:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787862454.078172:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862454.078176:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862454.078178:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862454.078420:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862454.078422:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862454.078424:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862454.078974:0:14365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787862454.082741:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787862454.107482:0:14365:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787862454.107503:0:14365:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787862454.107506:0:14365:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787862454.111871:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787862454.112175:0:14365:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787862454.112302:0:14365:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787862454.113141:0:14365:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787862454.116197:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862454.116395:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787862454.116402:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787862454.125562:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787862454.125577:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787862454.126274:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787862454.126281:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787862454.129232:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787862454.129258:0:14365:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.109@tcp' 00000020:01000004:1.0:1787862454.129260:0:14365:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787862454.129291:0:14365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.109@tcp (typ=mgc) 00000020:00000080:1.0:1787862454.129305:0:14365:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.109@tcp (ffff89a0055b0000) 00000020:00000080:1.0:1787862454.129320:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787862454.129400:0:14365:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a11ee68800@MGC192.168.202.109@tcp: add connection 192.168.202.109@tcp at head 00010000:00010000:1.0:1787862454.129605:0:14365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.109@tcp-0 is initialized 00000040:01000000:1.0:1787862454.129613:0:14365:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787862454.130479:0:14379:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787862454.131377:0:14380:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787862454.131480:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.109@tcp (uuid 079ae7a9-a8cb-4160-870b-e99ad994d115) 00000020:00000080:1.0:1787862454.131504:0:14365:0:(genops.c:1385:class_connect()) connect: client 079ae7a9-a8cb-4160-870b-e99ad994d115, cookie 0x391a6cd368cdab3b 00000100:00080000:1.0:1787862454.131519:0:14365:0:(import.c:510:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787862454.131525:0:14365:0:(import.c:624:import_select_connection()) MGC192.168.202.109@tcp: import ffff89a11ee68800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862454.131564:0:14365:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a96940 x1874709246472448/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787862454.131595:0:14365:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 079ae7a9-a8cb-4160-870b-e99ad994d115->MGS 00000020:01000004:1.0:1787862454.131615:0:14365:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787862454.131620:0:14365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787862454.131633:0:14365:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff89a0055b4ed8) 00000100:00100000:2.0:1787862454.131934:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079ae7a9-a8cb-4160-870b-e99ad994d115:3326:1874709246472448:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787862454.132009:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787862454.132146:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787862454.150150:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472448 00000100:00100000:0.0:1787862454.150166:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472448 00000100:00100000:1.0:1787862454.150879:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862454.151124:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862454.151130:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787862454.151346:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862454.151357:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3326:x1874709246472448:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787862454.151395:0:14376:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 079ae7a9-a8cb-4160-870b-e99ad994d115@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:0.0:1787862454.151432:0:14376:0:(genops.c:1385:class_connect()) connect: client 079ae7a9-a8cb-4160-870b-e99ad994d115, cookie 0x391a6cd368cdab49 00000100:00080000:0.0:1787862454.151579:0:14376:0:(import.c:65:import_set_state_nolock()) ffff89a007234000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862454.151711:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+5:3326:x1874709246472448:12345-0@lo:250:mount.lustre.0 Request processed in 353us (19699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.151720:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862454.153138:0:3326:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787862454.153153:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1787862454.153162:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787862454.153167:0:3326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787862454.153172:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11ee68800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787862454.153175:0:3326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787862454.153188:0:3326:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787862454.153197:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079ae7a9-a8cb-4160-870b-e99ad994d115:3326:1874709246472448:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787862454.155177:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787862454.155189:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787862454.155890:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787862454.155900:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787862454.156549:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862454.158942:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787862454.158953:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787862454.160303:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787862454.160314:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787862454.233032:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862454.233330:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787862454.233337:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787862454.234428:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787862454.234438:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787862454.235518:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862454.235760:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787862454.235766:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787862454.236453:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787862454.236461:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787862454.237020:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862454.237338:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787862454.237349:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787862454.237801:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787862454.237808:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787862454.238610:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862454.238835:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787862454.238841:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787862454.239608:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787862454.239617:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787862454.295013:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862454.296612:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862454.296620:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787862454.300349:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787862454.300365:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787862454.303439:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787862454.303455:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787862454.309980:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787862454.310004:0:14365:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787862454.310009:0:14365:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787862454.310300:0:14365:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787862454.310336:0:14365:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787862454.310340:0:14365:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787862454.310342:0:14365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862454.310343:0:14365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862454.310344:0:14365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862454.310346:0:14365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862454.310347:0:14365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862454.310352:0:14365:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862454.310354:0:14365:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862454.310355:0:14365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862454.310357:0:14365:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787862454.310359:0:14365:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787862454.310361:0:14365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787862454.310362:0:14365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862454.310363:0:14365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862454.310364:0:14365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862454.310365:0:14365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862454.310366:0:14365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862454.310367:0:14365:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862454.310368:0:14365:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862454.310369:0:14365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862454.310370:0:14365:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787862454.310398:0:14365:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787862454.310418:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787862454.310509:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.310587:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13ce36480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862454.310829:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472576 00000100:00100000:2.0:1787862454.310837:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472576 00000100:00100000:2.0:1787862454.310969:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862454.310980:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+5:14365:x1874709246472576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787862454.311027:0:14378:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787862454.311031:0:14378:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787862454.311034:0:14378:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787862454.311430:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787862454.311860:0:14378:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787862454.313401:0:14400:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787862454.313408:0:14400:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787862454.313411:0:14400:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787862454.313441:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787862454.313759:0:14378:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787862454.313770:0:14378:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787862454.319008:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+5:14365:x1874709246472576:12345-0@lo:253:mount.lustre.0 Request processed in 8019us (8488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.319022:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862454.319423:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787862454.319442:0:14365:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787862454.319446:0:14365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787862454.319447:0:14365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862454.319448:0:14365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862454.319450:0:14365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862454.319451:0:14365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862454.319452:0:14365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862454.319453:0:14365:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862454.319455:0:14365:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862454.319457:0:14365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862454.319459:0:14365:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787862454.319490:0:14365:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a104df9800 from lustre-MDT0000 10000000:01000000:1.0:1787862454.319529:0:14365:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787862454.319531:0:14365:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787862454.319536:0:14365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89a0055b0000 10000000:01000000:1.0:1787862454.319540:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862454.319548:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89a0055b0000 from 1 10000000:01000000:1.0:1787862454.319551:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787862454.319591:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.319603:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.319613:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862454.319634:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787862454.319874:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.320418:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862454.320496:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472704 00000100:00100000:0.0:1787862454.320503:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472704 00000100:00100000:0.0:1787862454.320596:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862454.320605:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+5:14365:x1874709246472704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862454.320619:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862454.320780:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e9c00/0x391a6cd368cdab57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdab50 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.320808:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9c00/0x391a6cd368cdab57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdab50 expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.320820:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e9c00/0x391a6cd368cdab57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdab50 expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.320829:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9c00, rc 0) 00000100:00100000:0.0:1787862454.320883:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+6:14365:x1874709246472704:12345-0@lo:101:mount.lustre.0 Request processed in 279us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.320891:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862454.320970:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862454.320985:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.320995:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862454.321086:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862454.321324:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.321448:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862454.321522:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472832 00000100:00100000:3.0:1787862454.321528:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472832 00000100:00100000:3.0:1787862454.321557:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862454.321565:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+6:14365:x1874709246472832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862454.321982:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472832:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787862454.322017:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787862454.322036:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322079:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862454.322088:0:14365:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a104df9800 10000000:01000000:1.0:1787862454.322094:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787862454.322099:0:14365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a104df9800 10000000:01000000:1.0:1787862454.322101:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787862454.322104:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89a104df9800 from 1 10000000:01000000:1.0:1787862454.322107:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787862454.322139:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322147:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322155:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862454.322276:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787862454.322305:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.322319:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862454.322373:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+6:14365:x1874709246472832:12345-0@lo:501:mount.lustre.0 Request processed in 334us (573us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862454.322382:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862454.322408:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246472960 00000100:00100000:3.0:1787862454.322411:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246472960 00000100:00100000:3.0:1787862454.322425:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862454.322431:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+6:14365:x1874709246472960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862454.322438:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862454.322450:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030400/0x391a6cd368cdab65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdab5e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.322479:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030400/0x391a6cd368cdab65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdab5e expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.322496:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030400/0x391a6cd368cdab65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdab5e expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.322505:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030400, rc 0) 00000100:00100000:3.0:1787862454.322539:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+7:14365:x1874709246472960:12345-0@lo:101:mount.lustre.0 Request processed in 108us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.322545:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862454.322615:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246472960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862454.322626:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab65 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322708:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdab65 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862454.322720:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787862454.322724:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab65 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322731:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8c00/0x391a6cd368cdab5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab65 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862454.322737:0:14365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787862454.322740:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862454.322744:0:14365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a104df9800 10000000:01000000:1.0:1787862454.322746:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787862454.322749:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787862454.322751:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787862454.322764:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322771:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.322778:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862454.322788:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787862454.322814:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.322834:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862454.322884:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246473088 00000100:00100000:3.0:1787862454.322887:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246473088 00000100:00100000:3.0:1787862454.322973:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862454.322981:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+7:14365:x1874709246473088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862454.322987:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862454.322994:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100031000/0x391a6cd368cdab73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdab6c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.323007:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100031000/0x391a6cd368cdab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdab6c expref: 8 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.323014:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100031000/0x391a6cd368cdab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdab6c expref: 8 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.323021:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031000, rc 0) 00000100:00100000:3.0:1787862454.323076:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+8:14365:x1874709246473088:12345-0@lo:101:mount.lustre.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.323082:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862454.323256:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862454.323267:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab73 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.323275:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdab73 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862454.323314:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862454.323335:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.323350:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862454.323392:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246473216 00000100:00100000:3.0:1787862454.323396:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246473216 00000100:00100000:3.0:1787862454.323419:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862454.323424:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+8:14365:x1874709246473216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862454.323885:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14365:x1874709246473216:12345-0@lo:501:mount.lustre.0 Request processed in 458us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.323893:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862454.324070:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862454.324102:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862454.324153:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.324179:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862454.324337:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246473344 00000100:00100000:0.0:1787862454.324342:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246473344 00000100:00100000:0.0:1787862454.324365:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862454.324376:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14365:x1874709246473344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862454.324696:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14365:x1874709246473344:12345-0@lo:503:mount.lustre.0 Request processed in 319us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.324704:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862454.324846:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862454.325480:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14401:1874709246473472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862454.325522:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.325555:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1028a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862454.325599:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246473472 00000100:00100000:0.0:1787862454.325604:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246473472 00000100:00100000:0.0:1787862454.325698:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862454.325708:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14401:x1874709246473472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862454.326109:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14401:x1874709246473472:12345-0@lo:502:llog_process_th.0 Request processed in 401us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.326124:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862454.326490:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14401:1874709246473472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862454.326516:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862454.326526:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.326529:0:14401:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787862454.326533:0:14401:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787862454.326535:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787862454.326549:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a0055b3490) 00000020:00000080:1.0:1787862454.326565:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787862454.326575:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787862454.326716:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787862454.326725:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdab81 00000020:00000080:1.0:1787862454.327010:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787862454.327014:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862454.327017:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.327019:0:14401:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787862454.327021:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862454.327025:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.327026:0:14401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787862454.327029:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787862454.327036:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a0055b1a48) 00000020:00000080:1.0:1787862454.327067:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787862454.327072:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787862454.327074:0:14401:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787862454.327077:0:14401:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787862454.327082:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787862454.327129:0:14401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a104df9800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787862454.327149:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a108604ed8) 00000020:00000080:1.0:1787862454.327158:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787862454.327310:0:14401:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787862454.327315:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cdab96 00000020:00000080:1.0:1787862454.327408:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787862454.327413:0:14401:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787862454.327417:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x391a6cd368cdab9d 00080000:01000000:1.0:1787862454.327422:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787862454.327425:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdaba4 00010000:00010000:0.0:1787862454.399868:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787862454.403095:0:14401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787862454.403510:0:14401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787862454.404573:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a13f9a1a48) 00000020:00000080:0.0:1787862454.404596:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787862454.404682:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787862454.404690:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdabb2 00000020:00000080:1.0:1787862454.405314:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787862454.413059:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x391a6cd368cdabb9 00000020:00000080:3.0:1787862454.423731:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787862454.423746:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862454.423756:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.423759:0:14401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787862454.423763:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787862454.423766:0:14401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787862454.423768:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787862454.423769:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787862454.423771:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787862454.423775:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.423777:0:14401:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787862454.423779:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862454.423785:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.423787:0:14401:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787862454.423791:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787862454.423838:0:14401:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787862454.423855:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862454.423858:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.423859:0:14401:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787862454.423862:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787862454.423865:0:14401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787862454.423868:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.423869:0:14401:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787862454.423872:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787862454.423878:0:14401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:3.0:1787862454.424077:0:14401:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787862454.424096:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787862454.424246:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a102b39a48) 00000020:00000080:3.0:1787862454.424412:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787862454.424420:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787862454.424542:0:14401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787862454.424774:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787862454.424788:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdabc7 00010000:00080000:3.0:1787862454.424828:0:14401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a112ba0000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:3.0:1787862454.425106:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787862454.426025:0:14401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787862454.426244:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787862454.428751:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862454.428819:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787862454.428990:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787862454.429840:0:14405:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862454.429846:0:14405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787862454.430829:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787862454.430842:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787862454.430878:0:14401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787862454.430910:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cdabce 00000100:00080000:3.0:1787862454.430922:0:14401:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787862454.430928:0:14401:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a112ba0000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862454.430966:0:14401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8fc00 x1874709246473600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862454.431075:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246473600:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787862454.431150:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709246473600 offset 0 length 520: 4 00000100:00080000:3.0:1787862454.431232:0:14401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787862454.431304:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862454.431308:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.431310:0:14401:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787862454.431313:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787862454.431316:0:14401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787862454.431318:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787862454.431320:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787862454.431321:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787862454.431329:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.431330:0:14401:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787862454.431334:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787862454.431338:0:14401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787862454.431341:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.431342:0:14401:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787862454.431345:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787862454.431348:0:14401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:3.0:1787862454.431368:0:14401:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787862454.431370:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787862454.431381:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a102b3ced8) 00000020:00000080:3.0:1787862454.431392:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787862454.431396:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787862454.431447:0:14401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787862454.431452:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787862454.431457:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x391a6cd368cdabdc 00010000:00080000:3.0:1787862454.431498:0:14401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a11c591800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:3.0:1787862454.432340:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787862454.432536:0:14401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787862454.434383:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787862454.435521:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862454.435875:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787862454.436030:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787862454.437356:0:14407:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862454.437363:0:14407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787862454.438379:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787862454.438392:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787862454.438426:0:14401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787862454.438450:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cdabe3 00000100:00080000:1.0:1787862454.438473:0:14401:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787862454.438488:0:14401:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a11c591800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862454.438526:0:14401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a96940 x1874709246473728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787862454.438892:0:14401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787862454.439012:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862454.439016:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.439018:0:14401:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787862454.439022:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862454.439025:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.439027:0:14401:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862454.439030:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862454.439031:0:14401:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787862454.439034:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862454.439036:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.439037:0:14401:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787862454.439068:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862454.439071:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.439073:0:14401:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787862454.439076:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787862454.439107:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14401:1874709246473856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862454.439413:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246473728:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787862454.439446:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709246473728 offset 0 length 520: 4 00000100:00100000:1.0:1787862454.439618:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.439674:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862454.440991:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246473856 00000100:00100000:2.0:1787862454.441003:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246473856 00000100:00100000:2.0:1787862454.441239:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787862454.441249:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14401:x1874709246473856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862454.441867:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14401:x1874709246473856:12345-0@lo:502:llog_process_th.0 Request processed in 617us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.441877:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787862454.442726:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14401:1874709246473856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862454.442882:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862454.442891:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862454.442893:0:14401:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787862454.442962:0:14401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787862454.443407:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787862454.443427:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787862454.443499:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab73 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.443512:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8600/0x391a6cd368cdab6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab73 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862454.443535:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a104df9800 from 1 10000000:01000000:0.0:1787862454.443538:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787862454.443592:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.443601:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.443611:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862454.443740:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787862454.443801:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862454.443849:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1084c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862454.443913:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246473984 00000100:00100000:2.0:1787862454.443920:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246473984 00000100:00100000:2.0:1787862454.443961:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787862454.443969:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+9:14365:x1874709246473984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862454.443984:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862454.444000:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdabea expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.444023:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdabea expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.444033:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdabea expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.444276:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f800, rc 0) 00000100:00100000:2.0:1787862454.444481:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+10:14365:x1874709246473984:12345-0@lo:101:mount.lustre.0 Request processed in 512us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.444489:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787862454.444788:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246473984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862454.444805:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.444824:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.446449:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474112:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787862454.446530:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.446782:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862454.446823:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474112 00000100:00100000:3.0:1787862454.446830:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474112 00000100:00100000:3.0:1787862454.446913:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787862454.446923:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+10:14365:x1874709246474112:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787862454.446942:0:14377:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787862454.446947:0:14377:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787862454.447022:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+10:14365:x1874709246474112:12345-0@lo:256:mount.lustre.0 Request processed in 101us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.447077:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862454.447338:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474112:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787862454.448089:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862454.448108:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.448120:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862454.448128:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a104df9800 from 1 10000000:01000000:2.0:1787862454.448130:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862454.448180:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.448187:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.448197:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.448216:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862454.448374:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.449313:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862454.449429:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474240 00000100:00100000:0.0:1787862454.449436:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474240 00000100:00100000:0.0:1787862454.449487:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862454.449496:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+10:14365:x1874709246474240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862454.449510:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862454.449528:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdabf8 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.449563:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.449573:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.449595:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9800, rc 0) 00000100:00100000:0.0:1787862454.449750:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246474240:12345-0@lo:101:mount.lustre.0 Request processed in 255us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.449757:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862454.450025:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862454.450244:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.450315:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.450379:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862454.450412:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.450481:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862454.450625:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474368 00000100:00100000:0.0:1787862454.450630:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474368 00000100:00100000:0.0:1787862454.450759:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862454.450766:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246474368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862454.451495:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246474368:12345-0@lo:501:mount.lustre.0 Request processed in 727us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.451504:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862454.451597:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862454.451645:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862454.451682:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.452027:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862454.452082:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474496 00000100:00100000:3.0:1787862454.452088:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474496 00000100:00100000:3.0:1787862454.452123:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787862454.452130:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246474496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862454.452529:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246474496:12345-0@lo:503:mount.lustre.0 Request processed in 398us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.452537:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862454.452871:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862454.453732:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14409:1874709246474624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862454.453783:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862454.453847:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862454.453887:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474624 00000100:00100000:2.0:1787862454.453892:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474624 00000100:00100000:2.0:1787862454.454020:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862454.454029:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14409:x1874709246474624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862454.454719:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14409:x1874709246474624:12345-0@lo:502:llog_process_th.0 Request processed in 518us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.454728:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787862454.454844:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14409:1874709246474624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862454.454872:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862454.454882:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.454885:0:14409:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787862454.454891:0:14409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a104df9800 00000020:00000080:3.0:1787862454.454894:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862454.454970:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862454.454974:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.454975:0:14409:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787862454.454978:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862454.454980:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.454982:0:14409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787862454.454985:0:14409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a104df9800 00000020:00000080:3.0:1787862454.454987:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862454.455148:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862454.455152:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.455153:0:14409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787862454.455173:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862454.455175:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862454.455177:0:14409:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787862454.455180:0:14409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89a104df9800 00000020:00000080:3.0:1787862454.455182:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787862454.457622:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14409:1874709246474752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862454.457783:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862454.457879:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a0071343c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862454.466047:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474752 00000100:00100000:1.0:1787862454.466064:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474752 00000100:00100000:1.0:1787862454.466123:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862454.466132:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14409:x1874709246474752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862454.467200:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14409:x1874709246474752:12345-0@lo:502:llog_process_th.0 Request processed in 1063us (9412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.467211:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862454.467393:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14409:1874709246474752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862454.467431:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862454.467438:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862454.467441:0:14409:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787862454.467446:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787862454.477482:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787862454.477526:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862454.477555:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.477570:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862454.477616:0:14365:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787862454.477619:0:14365:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a104df9800 10000000:01000000:2.0:1787862454.477622:0:14365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a104df9800 10000000:01000000:2.0:1787862454.477626:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862454.477632:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a104df9800 from 1 10000000:01000000:2.0:1787862454.477643:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862454.477681:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.477690:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.477701:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.477728:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862454.477797:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.477849:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98780 going to sleep for 11 seconds 00000100:00100000:2.0:1787862454.477873:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246474880 00000100:00100000:2.0:1787862454.477878:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246474880 00000100:00100000:2.0:1787862454.477917:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862454.477926:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246474880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862454.477941:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862454.477959:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e000/0x391a6cd368cdac0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdac06 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.477982:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e000/0x391a6cd368cdac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdac06 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.477993:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e000/0x391a6cd368cdac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac06 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.478001:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e000, rc 0) 00000100:00100000:2.0:1787862454.478036:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14365:x1874709246474880:12345-0@lo:101:mount.lustre.0 Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.478075:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862454.478127:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246474880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862454.478141:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac0d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.478149:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdac0d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.478201:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246475008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862454.478223:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.482825:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862454.487017:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475008 00000100:00100000:1.0:1787862454.487031:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475008 00000100:00100000:1.0:1787862454.487101:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862454.487122:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14365:x1874709246475008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862454.487783:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14365:x1874709246475008:12345-0@lo:501:mount.lustre.0 Request processed in 671us (9556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.487793:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862454.487990:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246475008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862454.488059:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246475136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862454.488102:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.488992:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862454.489251:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475136 00000100:00100000:1.0:1787862454.489317:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475136 00000100:00100000:1.0:1787862454.489353:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862454.489360:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14365:x1874709246475136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862454.489715:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14365:x1874709246475136:12345-0@lo:503:mount.lustre.0 Request processed in 354us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.489733:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862454.489879:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246475136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862454.500579:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14414:1874709246475264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862454.500683:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.500732:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475264 00000100:00100000:1.0:1787862454.500738:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475264 00000100:00100000:1.0:1787862454.500776:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787862454.500784:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14414:x1874709246475264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862454.501078:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14414:x1874709246475264:12345-0@lo:502:llog_process_th.0 Request processed in 293us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.501087:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787862454.501138:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1103f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787862454.501762:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14414:1874709246475264:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787862454.501964:0:14414:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787862454.501980:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a108603490) 00000020:00000080:1.0:1787862454.502000:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787862454.502115:0:14414:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a104df9800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787862454.502119:0:14414:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a104df9800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787862454.502122:0:14414:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a104df9800 4 00010000:00080000:1.0:1787862454.502151:0:14414:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a103f91800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:2.0:1787862454.513492:0:14414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787862454.514617:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787862454.515876:0:14414:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787862454.515893:0:14414:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x391a6cd368cdac1b 00000100:00080000:2.0:1787862454.517244:0:14414:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862454.517312:0:14414:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a103f91800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1787862454.517360:0:14414:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13d0b92c0 x1874709246475392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787862454.517384:0:14414:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787862454.518133:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246475392:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787862454.518211:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862454.518724:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475392 00000100:00100000:0.0:1787862454.518731:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475392 00000100:00100000:0.0:1787862454.518758:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862454.518766:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3326:x1874709246475392:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787862454.518823:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3326:x1874709246475392:12345-0@lo:38:llog_process_th.0 Request processed in 56us (610us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787862454.518830:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862454.518867:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862454.518874:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a103f91800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862454.518878:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787862454.518881:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246475392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787862454.523715:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14414:1874709246475520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862454.523793:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862454.523830:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13bd98780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862454.525874:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475520 00000100:00100000:0.0:1787862454.525884:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475520 00000100:00100000:0.0:1787862454.526001:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862454.526018:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14414:x1874709246475520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862454.527803:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14414:x1874709246475520:12345-0@lo:502:llog_process_th.0 Request processed in 1778us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.527815:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862454.527902:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079ae7a9-a8cb-4160-870b-e99ad994d115:14414:1874709246475520:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787862454.527941:0:14414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787862454.531609:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787862454.531653:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862454.531722:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac0d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862454.531736:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79f400/0x391a6cd368cdac06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac0d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787862454.531814:0:14365:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787862454.531816:0:14365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787862454.531817:0:14365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862454.531819:0:14365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862454.531820:0:14365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862454.531821:0:14365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862454.531823:0:14365:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787862454.531824:0:14365:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787862454.531827:0:14365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862454.531828:0:14365:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787862454.531832:0:14365:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787862454.531835:0:14365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787862454.531836:0:14365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787862454.531837:0:14365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862454.531838:0:14365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862454.531839:0:14365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862454.531840:0:14365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862454.531842:0:14365:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787862454.531843:0:14365:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787862454.531852:0:14365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862454.531852:0:14365:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787862454.531895:0:14365:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787862454.531921:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246475648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787862454.531996:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862454.532072:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a007134000 going to sleep for 11 seconds 00000100:00100000:2.0:1787862454.533321:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475648 00000100:00100000:2.0:1787862454.533333:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475648 00000100:00100000:2.0:1787862454.533399:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862454.533409:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14365:x1874709246475648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787862454.533441:0:14377:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787862454.533457:0:14377:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787862454.608624:0:14377:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787862454.608646:0:14377:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787862454.608709:0:14399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787862454.608714:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787862454.608743:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.608767:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdabea expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.608777:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.608826:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdabea expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.608841:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdabea expref: 12 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862454.608855:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874709246475776:0@lo:104: 00000100:00100000:0.0:1787862454.608936:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862454.608989:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d6dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862454.611145:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475776 00000100:00100000:1.0:1787862454.611163:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475776 00000100:00100000:1.0:1787862454.611387:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862454.611410:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14399:x1874709246475776:12345-0@lo:104: 00010000:00010000:1.0:1787862454.611431:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611532:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862454.611539:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14399:x1874709246475776:12345-0@lo:104: Request processed in 131us (2603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.611547:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862454.611591:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874709246475776:0@lo:104: 00010000:00010000:1.0:1787862454.611615:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611633:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862454.611639:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611647:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9200 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:1.0:1787862454.611652:0:14372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611660:0:14372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862454.611668:0:14372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862454.611674:0:14372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862454.611711:0:14372:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611728:0:14372:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862454.611752:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611759:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1420e9200/0x391a6cd368cdabea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdabf1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.611778:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862454.611780:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862454.611781:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862454.611811:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246475904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862454.611847:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.611921:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246475904 00000100:00100000:1.0:1787862454.611925:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246475904 00010000:00010000:1.0:1787862454.611942:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdabea expref: 13 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862454.611966:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862454.611973:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+13:3327:x1874709246475904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862454.611985:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862454.611990:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdabea expref: 13 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612001:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdabea expref: 13 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612017:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79f800/0x391a6cd368cdabf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdabea expref: 13 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612100:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612123:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787862454.612140:0:14368:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003425852s 00010000:00010000:1.0:1787862454.612145:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612152:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612159:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612164:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612169:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e9e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862454.612172:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612180:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.612192:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.614710:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862454.614822:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:3327:x1874709246475904:12345-0@lo:103:ldlm_bl.0 Request processed in 2844us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.614834:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787862454.614879:0:14399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.615562:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246475904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862454.615657:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.615664:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1420e9e00/0x391a6cd368cdac22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862454.625368:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14365:x1874709246475648:12345-0@lo:253:mount.lustre.0 Request processed in 91952us (93363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.625383:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787862454.625521:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:14365:1874709246475648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787862454.625539:0:14365:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787862454.625543:0:14365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862454.625545:0:14365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787862454.625546:0:14365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862454.625553:0:14365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862454.625554:0:14365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862454.625555:0:14365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862454.625557:0:14365:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787862454.625558:0:14365:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787862454.625560:0:14365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862454.625561:0:14365:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787862454.625579:0:14365:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787862454.630768:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862454.631106:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862454.631516:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862454.631657:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862454.631916:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862454.632617:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862454.634398:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862454.634576:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862454.634849:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862454.635369:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862454.635640:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862454.635790:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787862454.665604:0:14365:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787862454.666144:0:14365:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787862454.666431:0:14421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787862454.666500:0:14421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862454.670788:0:14421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787862454.670869:0:14421:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787862454.670873:0:14421:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787862454.672506:0:14365:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787862454.672612:0:14365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1787862454.672978:0:14420:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787862454.672983:0:14420:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:0.0:1787862454.673308:0:14365:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787862454.673317:0:14365:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787862454.673441:0:14365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862454.675321:0:14365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787862454.676237:0:14365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787862454.676286:0:14365:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787862454.677807:0:14365:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787862454.685373:0:14365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787862454.707696:0:14365:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787862454.707736:0:14365:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8d2814a3988 00100000:10000000:0.0:1787862454.707745:0:14365:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787862454.708198:0:14365:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787862454.708214:0:14365:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787862454.708226:0:14365:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787862454.708242:0:14365:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787862455.110232:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862455.559012:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787862455.621213:0:14380:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787862455.621222:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a104df9800 from 6 10000000:01000000:1.0:1787862455.621227:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787862455.621275:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.621288:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.621300:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862455.621327:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246476032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862455.621400:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862455.621458:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a10319ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862455.621593:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476032 00000100:00100000:0.0:1787862455.621602:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476032 00000100:00100000:0.0:1787862455.622509:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862455.622525:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14380:x1874709246476032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862455.622541:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862455.622559:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdac29 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862455.622586:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862455.622599:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862455.622609:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9400, rc 0) 00000100:00100000:0.0:1787862455.622676:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246476032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862455.622691:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862455.622787:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246476032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862455.622805:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862455.622814:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862455.622890:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246476160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787862455.622927:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862455.626787:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d128540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862455.627023:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476160 00000100:00100000:0.0:1787862455.627033:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476160 00000100:00100000:0.0:1787862455.627268:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787862455.627281:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246476160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787862455.627308:0:14376:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787862455.627327:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787862455.627331:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787862455.627470:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246476160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862455.627478:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862455.627659:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246476160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787862455.627713:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862455.627723:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862455.627734:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862456.134355:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862456.580775:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787862457.157277:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862458.182239:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862459.207579:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862459.614937:0:14664:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787862459.909646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862459.909653:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787862459.909656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862459.909660:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787862459.909663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787862459.909666:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787862459.909670:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a103f91800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862459.909682:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a103f91800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862459.909706:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8e940 x1874709246476416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862459.909768:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079ae7a9-a8cb-4160-870b-e99ad994d115:3328:1874709246476288:0@lo:400:kworker.0 00000100:00100000:3.0:1787862459.910018:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862459.910343:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246476416:0@lo:38:kworker.0 00000100:00100000:3.0:1787862459.910405:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862459.910474:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476288 00000100:00100000:3.0:1787862459.910482:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476288 00000100:00100000:3.0:1787862459.910535:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787862459.910547:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:3328:x1874709246476288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862459.910606:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:3328:x1874709246476288:12345-0@lo:400:kworker.0 Request processed in 62us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862459.910613:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787862459.910660:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079ae7a9-a8cb-4160-870b-e99ad994d115:3328:1874709246476288:0@lo:400:kworker.0 00000100:00100000:2.0:1787862459.912455:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476416 00000100:00100000:2.0:1787862459.912467:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476416 00000100:00100000:2.0:1787862459.912535:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862459.912543:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3326:x1874709246476416:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787862459.912572:0:14385:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1787862459.912610:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x391a6cd368cdac37 00000004:00100000:2.0:1787862459.912625:0:14385:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787862459.912775:0:14385:0:(import.c:65:import_set_state_nolock()) ffff89a127d2b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862459.912856:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874709246476416:12345-0@lo:38:kworker.0 Request processed in 313us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862459.912864:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787862459.914112:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a13cb8e940 x1874709246476416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787862459.914142:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787862459.914151:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787862459.914166:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787862459.914170:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a103f91800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787862459.914176:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874709246476416:0@lo:38:kworker.0 00010000:00010000:3.0:1787862460.230713:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862461.252644:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862462.276341:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787862462.791202:0:14815:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2053d510 20000000:00000080:3.0:1787862462.791219:0:14815:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a1120ab800 uarg=0000000000000000 20000000:01000000:3.0:1787862462.791363:0:14815:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787862462.791371:0:14815:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787862462.791376:0:14815:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787862462.792949:0:14816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787862462.793457:0:14815:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787862462.804026:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787862462.805644:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862462.805669:0:14815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862462.805694:0:14815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862462.805758:0:14815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862462.805777:0:14815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 11 pid: 14376 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862462.805792:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14815:1874709246476544:0@lo:104: 00000100:00100000:3.0:1787862462.805871:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862462.805941:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a119297a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862462.806489:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476544 00000100:00100000:0.0:1787862462.806497:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476544 00000100:00100000:0.0:1787862462.806544:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862462.806552:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14815:x1874709246476544:12345-0@lo:104: 00010000:00010000:0.0:1787862462.806567:0:14367:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.806645:0:14367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862462.806651:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14815:x1874709246476544:12345-0@lo:104: Request processed in 100us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862462.806658:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787862462.806681:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862462.806687:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.806694:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fa00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862462.806698:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.806706:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862462.806775:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862462.806782:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787862462.806814:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.806821:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862462.806842:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.806849:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdabf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdabff expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.806877:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862462.806879:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862462.806881:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862462.806906:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862462.806916:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246476672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862462.806950:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862462.806987:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476672 00000100:00100000:0.0:1787862462.806991:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476672 00010000:00010000:0.0:1787862462.807008:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 12 pid: 14376 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862462.807030:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862462.807036:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:3330:x1874709246476672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862462.807073:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787862462.807713:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14815:1874709246476544:0@lo:104: 00010000:00010000:1.0:1787862462.807749:0:14815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807889:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 12 pid: 14376 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807901:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 12 pid: 14376 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807916:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdabff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdabf8 expref: 12 pid: 14376 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807930:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807939:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807965:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807972:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807977:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807984:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.807990:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862462.807993:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.808002:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.808024:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862462.808033:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862462.808554:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+11:3330:x1874709246476672:12345-0@lo:103:ldlm_bl.0 Request processed in 1516us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862462.808563:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862462.808654:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246476672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862462.808778:0:14815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862462.808787:0:14815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862462.808804:0:14815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100031600/0x391a6cd368cdac3e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862463.301620:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862464.006288:0:3326:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862454/real 1787862454] req@ffff89a006a96940 x1874709246473728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862464.006319:0:3326:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a006a96940 x1874709246473728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862464.006343:0:3326:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862454/real 1787862454] req@ffff89a13cb8fc00 x1874709246473600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862464.006355:0:3326:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a13cb8fc00 x1874709246473600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787862464.006386:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862464.006445:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787862464.006450:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246473728:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787862464.006456:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a112ba0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862464.006578:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862464.006583:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787862464.006585:0:38:0:(import.c:65:import_set_state_nolock()) ffff89a112ba0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862464.006590:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1787862464.006595:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787862464.006601:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a112ba0000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862464.006623:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a95680 x1874709246476928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787862464.006633:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862464.006635:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787862464.006637:0:38:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862464.006640:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1787862464.006643:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787862464.006647:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a11c591800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862464.006656:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a97c00 x1874709246477056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862464.007077:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862464.007090:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079ae7a9-a8cb-4160-870b-e99ad994d115:3329:1874709246476800:0@lo:400:kworker.0 00000100:00100000:2.0:1787862464.007155:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862464.007260:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246476800 00000100:00100000:1.0:1787862464.007267:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246476800 00000100:00100000:1.0:1787862464.007309:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862464.007318:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+11:3329:x1874709246476800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862464.007366:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+11:3329:x1874709246476800:12345-0@lo:400:kworker.0 Request processed in 49us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862464.007395:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787862464.007476:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246477184:0@lo:400:kworker.0 00000100:00100000:3.0:1787862464.007505:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862464.007581:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477184 00000100:00100000:1.0:1787862464.007585:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477184 00000100:00100000:1.0:1787862464.007617:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862464.007624:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246477184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862464.007656:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246477184:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862464.007663:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862464.007721:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079ae7a9-a8cb-4160-870b-e99ad994d115:3329:1874709246476800:0@lo:400:kworker.0 00010000:00080000:3.0:1787862464.007865:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a006a97840 x1874709246477184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862464.007877:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246477184:0@lo:400:kworker.0 00000100:00080000:0.0:1787862464.010079:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787862464.010089:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246473600:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787862464.010126:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246476928:0@lo:8:kworker.0 00000400:00000100:0.0:1787862464.010175:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709246476928 offset 0 length 520: 4 00000100:00100000:0.0:1787862464.010207:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246477056:0@lo:8:kworker.0 00000400:00000100:0.0:1787862464.010238:0:3326:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709246477056 offset 0 length 520: 4 10000000:01000000:0.0:1787862464.324256:0:14380:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862464.324266:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a104df9800 from 10 10000000:01000000:0.0:1787862464.324271:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862464.324318:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862464.324330:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862464.324341:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862464.324404:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246477312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862464.324472:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862464.324530:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11026a300 going to sleep for 11 seconds 00010000:00010000:0.0:1787862464.324679:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862464.324876:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477312 00000100:00100000:3.0:1787862464.324882:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477312 00000100:00100000:3.0:1787862464.324933:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862464.324942:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+11:14380:x1874709246477312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862464.324956:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862464.324969:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdac45 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862464.325002:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862464.325012:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862464.325032:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100031e00, rc 0) 00000100:00100000:3.0:1787862464.325223:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246477312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862464.325231:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862464.325313:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246477312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862464.325327:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862464.325336:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862464.325403:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246477440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862464.325430:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862464.325458:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11026a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787862464.325509:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477440 00000100:00100000:2.0:1787862464.325514:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477440 00000100:00100000:2.0:1787862464.325545:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787862464.325553:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246477440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862464.325999:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246477440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862464.326006:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862464.326151:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246477440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862464.326179:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246477568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862464.326212:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862464.326237:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11026a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787862464.326283:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477568 00000100:00100000:3.0:1787862464.326287:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477568 00000100:00100000:3.0:1787862464.326314:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862464.326320:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246477568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862464.326535:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:14380:x1874709246477568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862464.326542:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862464.327104:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246477568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787862464.328611:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787862464.329299:0:14380:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787862464.329328:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862464.329338:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862464.329350:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862465.348247:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862466.372916:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862466.824728:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787862467.397246:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862468.423101:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862469.124563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862469.124572:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787862469.124576:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862469.124579:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787862469.124633:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079ae7a9-a8cb-4160-870b-e99ad994d115:3328:1874709246477696:0@lo:400:kworker.0 00000100:00100000:1.0:1787862469.124747:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.124827:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246477824:0@lo:400:kworker.0 00000100:00100000:1.0:1787862469.124864:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.124908:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477696 00000100:00100000:1.0:1787862469.124917:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477696 00000100:00100000:1.0:1787862469.124976:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862469.124987:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:3328:x1874709246477696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862469.125070:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+12:3328:x1874709246477696:12345-0@lo:400:kworker.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.125099:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862469.125143:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477824 00000100:00100000:1.0:1787862469.125147:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477824 00000100:00100000:1.0:1787862469.125178:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862469.125186:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246477824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862469.125224:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246477824:12345-0@lo:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.125230:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787862469.125271:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a006a94f00 x1874709246477824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862469.125286:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246477824:0@lo:400:kworker.0 00000100:00100000:1.0:1787862469.125312:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079ae7a9-a8cb-4160-870b-e99ad994d115:3328:1874709246477696:0@lo:400:kworker.0 00010000:00010000:3.0:1787862469.455359:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787862469.509881:0:15064:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787862469.509886:0:15064:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787862469.510008:0:15064:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89a13d89c000 00000020:01000004:1.0:1787862469.510025:0:15064:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787862469.510070:0:15064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787862469.510083:0:15064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89a108601a48) 00000020:00000080:1.0:1787862469.510097:0:15064:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787862469.530177:0:15064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787862469.530489:0:15064:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787862469.531342:0:15064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787862469.531577:0:15064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787862469.531782:0:15064:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787862469.532269:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 381: rc = 0 00100000:10000000:1.0:1787862469.532433:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 381: rc = 0 00100000:10000000:1.0:1787862469.532571:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 381: rc = 0 00100000:10000000:1.0:1787862469.533408:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1787862469.533659:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:1.0:1787862469.533905:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1787862469.534237:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1787862469.534468:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:1.0:1787862469.534703:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00000020:00000080:1.0:1787862469.535458:0:15064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787862469.535471:0:15064:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787862469.535494:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x391a6cd368cdac5a 00000020:01000004:1.0:1787862469.535503:0:15064:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787862469.535525:0:15064:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787862469.535529:0:15064:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787862469.535536:0:15064:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787862469.535540:0:15064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787862469.535550:0:15064:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89a108600000) 00000020:00000080:1.0:1787862469.535565:0:15064:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787862469.536785:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862469.536957:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862469.537360:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787862469.543118:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862469.543136:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787862469.543598:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862469.543604:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787862469.556153:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862469.556348:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787862469.556354:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787862469.565015:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787862469.565030:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787862469.580524:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862469.581875:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862469.581885:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787862469.583242:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862469.583253:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787862469.585279:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787862469.585292:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787862469.590386:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862469.590565:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787862469.590575:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787862469.591393:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787862469.591399:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787862469.666462:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862469.668237:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787862469.668246:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787862469.671828:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787862469.671844:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787862469.672683:0:15064:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787862469.672713:0:15064:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787862469.672721:0:15064:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787862469.684773:0:15064:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787862469.684824:0:15064:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787862469.684828:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787862469.684830:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862469.684831:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862469.684833:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862469.684834:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862469.684835:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862469.684836:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862469.684839:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862469.684840:0:15064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787862469.684844:0:15064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787862469.684846:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787862469.684848:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862469.684849:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862469.684850:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862469.684851:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862469.684852:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862469.684853:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862469.684854:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862469.684856:0:15064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787862469.684885:0:15064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787862469.684908:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246477952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787862469.684983:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.685065:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d6df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.685468:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246477952 00000100:00100000:3.0:1787862469.685477:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246477952 00000100:00100000:3.0:1787862469.685538:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862469.685547:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:15064:x1874709246477952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787862469.685588:0:14377:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787862469.685591:0:14377:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787862469.685594:0:14377:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787862469.698033:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:15064:x1874709246477952:12345-0@lo:253:mount.lustre.0 Request processed in 12412us (12975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.698073:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862469.698160:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246477952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787862469.698178:0:15064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787862469.698182:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787862469.698184:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862469.698185:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862469.698186:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862469.698187:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862469.698189:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862469.698190:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862469.698208:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862469.698209:0:15064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787862469.698232:0:15064:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a13d89c000 from lustre-OST0000 10000000:01000000:2.0:1787862469.698358:0:15064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787862469.698363:0:15064:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787862469.698372:0:15064:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a0055b0000 local copy 00010000:00010000:2.0:1787862469.698383:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862469.698691:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862469.698732:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.698769:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478080 00000100:00100000:2.0:1787862469.698775:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478080 00000100:00100000:2.0:1787862469.698908:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862469.698920:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:15064:x1874709246478080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862469.699105:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+12:15064:x1874709246478080:12345-0@lo:501:mount.lustre.0 Request processed in 186us (371us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862469.699113:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862469.699156:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c437b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862469.699171:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787862469.699184:0:15064:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787862469.699453:0:15064:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787862469.699461:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.699471:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862469.699508:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a13d89c000 10000000:01000000:2.0:1787862469.699521:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787862469.699527:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89a0055b0000 10000000:01000000:2.0:1787862469.699530:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787862469.699533:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89a0055b0000 from 1 10000000:01000000:2.0:1787862469.699536:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787862469.699565:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.699573:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.699583:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862469.699598:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862469.699633:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.699664:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478208 00000100:00100000:2.0:1787862469.699668:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478208 00000100:00100000:2.0:1787862469.699694:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862469.699701:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b24c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+12:15064:x1874709246478208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862469.699711:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862469.699724:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e800/0x391a6cd368cdac6f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdac68 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.699745:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e800/0x391a6cd368cdac6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdac68 expref: 13 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.699756:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e800/0x391a6cd368cdac6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac68 expref: 13 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.699775:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e800, rc 0) 00000100:00100000:2.0:1787862469.699800:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b24c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+13:15064:x1874709246478208:12345-0@lo:101:mount.lustre.0 Request processed in 100us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.699806:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862469.700028:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c437b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862469.700070:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862469.700085:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac6f expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700095:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdac6f expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862469.700113:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787862469.700124:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac6f expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700132:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79f800/0x391a6cd368cdac68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac6f expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862469.700139:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787862469.700142:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862469.700147:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787862469.700149:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787862469.700162:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700169:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700184:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862469.700196:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862469.700220:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.700239:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478336 00000100:00100000:2.0:1787862469.700242:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478336 00000100:00100000:2.0:1787862469.700261:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862469.700266:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+13:15064:x1874709246478336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862469.700273:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862469.700362:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e600/0x391a6cd368cdac7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdac76 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700378:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e600/0x391a6cd368cdac7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdac76 expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700387:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e600/0x391a6cd368cdac7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac76 expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700393:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e600, rc 0) 00000100:00100000:2.0:1787862469.700416:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478336:12345-0@lo:101:mount.lustre.0 Request processed in 150us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.700422:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862469.700446:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c437b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862469.700458:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862469.700467:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac7d expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.700481:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdac7d expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862469.701914:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787862469.703256:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862469.703714:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787862469.703761:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787862469.703796:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787862469.704102:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787862469.704143:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787862469.704174:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787862469.704241:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787862469.704248:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787862469.704484:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862469.704640:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.704761:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c437840 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.704985:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478464 00000100:00100000:3.0:1787862469.704993:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478464 00000100:00100000:3.0:1787862469.705057:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787862469.705068:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862469.705482:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478464:12345-0@lo:501:mount.lustre.0 Request processed in 414us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.705490:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787862469.705566:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862469.705606:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862469.705649:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.705675:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478592 00000100:00100000:3.0:1787862469.705679:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478592 00000100:00100000:3.0:1787862469.705703:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787862469.705710:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862469.705994:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478592:12345-0@lo:503:mount.lustre.0 Request processed in 283us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.706000:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787862469.706032:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c87d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.706066:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787862469.706968:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862469.707079:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862469.707128:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.707165:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478720 00000100:00100000:3.0:1787862469.707170:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478720 00000100:00100000:3.0:1787862469.707201:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787862469.707208:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862469.707393:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478720:12345-0@lo:502:mount.lustre.0 Request processed in 184us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.707401:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787862469.707440:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c87d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.707455:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862469.707687:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787862469.707729:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787862469.707757:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787862469.707798:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787862469.707827:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787862469.707856:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787862469.707899:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787862469.707937:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787862469.707971:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787862469.708020:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787862469.708076:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787862469.708142:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787862469.708169:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862469.708211:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.708250:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478848 00000100:00100000:3.0:1787862469.708255:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478848 00000100:00100000:3.0:1787862469.708280:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787862469.708287:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862469.713031:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478848:12345-0@lo:502:mount.lustre.0 Request processed in 4733us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.713062:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787862469.713207:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c87d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.713234:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862469.713896:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787862469.713918:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787862469.715965:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787862469.715978:0:15079:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787862469.715995:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.715997:0:15079:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787862469.716007:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787862469.716026:0:15079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89a13f9a3490) 00000020:00000080:0.0:1787862469.716163:0:15079:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787862469.716171:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787862469.716238:0:15079:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a13d89c000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787862469.716246:0:15079:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787862469.716252:0:15079:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x391a6cd368cdac8b 00010000:00010000:0.0:1787862469.724947:0:15079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787862469.725782:0:15079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787862469.728633:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1787862469.732889:0:15079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787862469.732909:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862469.733197:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.733200:0:15079:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787862469.733206:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787862469.733209:0:15079:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787862469.733211:0:15079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787862469.733212:0:15079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787862469.733214:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787862469.733217:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.733219:0:15079:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787862469.733221:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862469.733225:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.733226:0:15079:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787862469.733230:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787862469.733231:0:15079:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787862469.733233:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862469.733236:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.733237:0:15079:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787862469.733239:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862469.733241:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.733242:0:15079:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787862469.733253:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787862469.733717:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862469.733723:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.733725:0:15079:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787862469.733729:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787862469.734638:0:15064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787862469.734769:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787862469.734801:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac7d expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.734913:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79fe00/0x391a6cd368cdac76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac7d expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862469.734925:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a13d89c000 from 1 10000000:01000000:3.0:1787862469.734929:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862469.734970:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.734979:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.734990:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862469.735031:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787862469.735131:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.735176:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c87d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862469.735437:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246478976 00000100:00100000:0.0:1787862469.735446:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246478976 00000100:00100000:0.0:1787862469.735550:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862469.735561:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+14:15064:x1874709246478976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862469.735574:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862469.735589:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdac92 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.735615:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 15 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.735627:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 15 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.735636:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8e00, rc 0) 00000100:00100000:0.0:1787862469.735693:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246478976:12345-0@lo:101:mount.lustre.0 Request processed in 135us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.735700:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787862469.735770:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246478976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862469.735784:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.735793:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862469.737536:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787862469.738240:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862469.738492:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787862469.738530:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787862469.738592:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787862469.738605:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787862469.738691:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862469.738780:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.739746:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c4376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862469.739882:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479104 00000100:00100000:1.0:1787862469.739892:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479104 00000100:00100000:1.0:1787862469.739952:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787862469.739962:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862469.740820:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479104:12345-0@lo:501:mount.lustre.0 Request processed in 857us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.740830:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862469.742427:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862469.742491:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862469.742576:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.742612:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c4376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862469.743407:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479232 00000100:00100000:1.0:1787862469.743417:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479232 00000100:00100000:1.0:1787862469.743472:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787862469.743484:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862469.743739:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479232:12345-0@lo:503:mount.lustre.0 Request processed in 257us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.743748:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787862469.744419:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787862469.745169:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862469.745267:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862469.745623:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.745728:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c4376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862469.745831:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479360 00000100:00100000:1.0:1787862469.745839:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479360 00000100:00100000:1.0:1787862469.745896:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862469.745906:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862469.746158:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479360:12345-0@lo:502:mount.lustre.0 Request processed in 252us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.746167:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787862469.746632:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787862469.746964:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787862469.747016:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787862469.747083:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787862469.747115:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787862469.747143:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787862469.747183:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787862469.747211:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787862469.747236:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787862469.747270:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862469.747954:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.748001:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c4376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.748097:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479488 00000100:00100000:3.0:1787862469.748107:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479488 00000100:00100000:3.0:1787862469.748166:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787862469.748176:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862469.748431:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479488:12345-0@lo:502:mount.lustre.0 Request processed in 255us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.748438:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787862469.748798:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787862469.748936:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787862469.748950:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787862469.750217:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862469.750228:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.750230:0:15083:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787862469.750238:0:15083:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a13d89c000 00000020:00000080:2.0:1787862469.750240:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787862469.750247:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862469.750250:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.750251:0:15083:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787862469.750254:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862469.750256:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.750257:0:15083:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787862469.750260:0:15083:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a13d89c000 00000020:00000080:2.0:1787862469.750262:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787862469.752909:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862469.752929:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.752932:0:15083:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787862469.752937:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862469.752941:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.752942:0:15083:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787862469.752947:0:15083:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89a13d89c000 00000020:00000080:2.0:1787862469.752949:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787862469.753066:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862469.753069:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.753071:0:15083:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787862469.753074:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787862469.753272:0:15064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787862469.753305:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862469.753348:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.753361:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862469.753421:0:15064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787862469.753423:0:15064:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a13d89c000 10000000:01000000:0.0:1787862469.753426:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a13d89c000 10000000:01000000:0.0:1787862469.753430:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862469.753435:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a13d89c000 from 1 10000000:01000000:0.0:1787862469.753437:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787862469.753470:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.753478:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.753489:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862469.753522:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787862469.753587:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.753623:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13d6df900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.753945:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479616 00000100:00100000:3.0:1787862469.753955:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479616 00000100:00100000:3.0:1787862469.754009:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787862469.754018:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246479616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862469.754032:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862469.754084:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a100030e00/0x391a6cd368cdaca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdaca0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.754109:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a100030e00/0x391a6cd368cdaca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdaca0 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.754119:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a100030e00/0x391a6cd368cdaca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdaca0 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.754127:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a100030e00, rc 0) 00000100:00100000:3.0:1787862469.754165:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246479616:12345-0@lo:101:mount.lustre.0 Request processed in 149us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.754177:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862469.755451:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862469.755471:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaca7 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.755481:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdaca7 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862469.756408:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787862469.756894:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862469.757179:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787862469.757224:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787862469.757264:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787862469.757337:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787862469.757377:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787862469.757436:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787862469.757473:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787862469.759905:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787862469.763771:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787862469.763888:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787862469.763931:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787862469.764022:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787862469.764435:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787862469.764502:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787862469.764569:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787862469.764635:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787862469.764680:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787862469.764748:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787862469.764806:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787862469.764866:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787862469.764920:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787862469.764967:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787862469.765016:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787862469.765107:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787862469.765501:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787862469.765559:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787862469.765617:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787862469.765660:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787862469.765765:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787862469.765775:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787862469.767069:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862469.767444:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.767511:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a119297480 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.767593:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479744 00000100:00100000:3.0:1787862469.767602:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479744 00000100:00100000:3.0:1787862469.767739:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787862469.767750:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a102916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246479744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862469.768070:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a102916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246479744:12345-0@lo:501:mount.lustre.0 Request processed in 321us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.768079:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862469.768200:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862469.768253:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862469.768370:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.768393:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a119297480 going to sleep for 11 seconds 00000100:00100000:1.0:1787862469.768467:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246479872 00000100:00100000:1.0:1787862469.768471:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246479872 00000100:00100000:1.0:1787862469.768523:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787862469.768528:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246479872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862469.769392:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246479872:12345-0@lo:503:mount.lustre.0 Request processed in 858us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.769403:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787862469.769562:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246479872:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787862469.770922:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862469.771028:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246480000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862469.771277:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.771325:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a119297480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862469.771966:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480000 00000100:00100000:2.0:1787862469.771975:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480000 00000100:00100000:2.0:1787862469.772014:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787862469.772021:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246480000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862469.772271:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246480000:12345-0@lo:502:mount.lustre.0 Request processed in 250us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.772284:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787862469.772498:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246480000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862469.772841:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787862469.772903:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787862469.772943:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787862469.773590:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787862469.773648:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787862469.773702:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787862469.773800:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787862469.773851:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787862469.775362:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787862469.775444:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787862469.775478:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787862469.775553:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787862469.775588:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787862469.775727:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787862469.775774:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787862469.775805:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787862469.775833:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787862469.775873:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787862469.775905:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787862469.775937:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787862469.775979:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787862469.776010:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787862469.776061:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787862469.776122:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787862469.776158:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787862469.776198:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787862469.776267:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787862469.776586:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787862469.776750:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787862469.776803:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787862469.776839:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787862469.776927:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787862469.776962:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787862469.777013:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787862469.777340:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787862469.777398:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787862469.777436:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787862469.777471:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787862469.777520:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787862469.777556:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787862469.777813:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246480128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862469.777910:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.777967:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c3f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787862469.777986:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480128 00000100:00100000:1.0:1787862469.777995:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480128 00000100:00100000:1.0:1787862469.778086:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862469.778171:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246480128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862469.778444:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246480128:12345-0@lo:502:mount.lustre.0 Request processed in 343us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.778454:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787862469.778494:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246480128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862469.778580:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787862469.778592:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787862469.779704:0:15088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787862469.779732:0:15088:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89a0060bb490) 00000020:00000080:1.0:1787862469.779757:0:15088:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787862469.779840:0:15088:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a13d89c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787862469.779845:0:15088:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a13d89c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787862469.779848:0:15088:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a13d89c000 3 00010000:00080000:1.0:1787862469.779892:0:15088:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a006e9d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1787862469.783906:0:15088:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787862469.784225:0:15088:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787862469.784265:0:15088:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787862469.784278:0:15088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x391a6cd368cdacb5 00000100:00080000:0.0:1787862469.784290:0:15088:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787862469.784297:0:15088:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a006e9d000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1787862469.784346:0:15088:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a005bccf00 x1874709246480256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862469.784396:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246480256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787862469.784476:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.784550:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480256 00000100:00100000:0.0:1787862469.784557:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480256 00000100:00100000:0.0:1787862469.784593:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862469.784667:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3326:x1874709246480256:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787862469.784694:0:14383:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:0.0:1787862469.784728:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x391a6cd368cdacbc 00000004:00100000:0.0:1787862469.784744:0:14383:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787862469.784778:0:14383:0:(import.c:65:import_set_state_nolock()) ffff89a006011000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862469.784831:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874709246480256:12345-0@lo:38:llog_process_th.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.784840:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787862469.784880:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89a005bccf00 x1874709246480256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862469.784896:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862469.784905:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787862469.784913:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787862469.784917:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787862469.784921:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a006e9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787862469.784928:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3326:1874709246480256:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787862469.784952:0:15088:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787862469.784976:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787862469.784980:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787862469.784983:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787862469.784986:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787862469.786564:0:15088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787862469.786726:0:15064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787862469.786757:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862469.786812:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaca7 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.786824:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1420e9e00/0x391a6cd368cdaca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaca7 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787862469.786872:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787862469.786875:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862469.786876:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862469.786878:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862469.786880:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862469.786882:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862469.786884:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862469.786886:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862469.786893:0:15064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787862469.786898:0:15064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787862469.786900:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787862469.786902:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862469.786903:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862469.786904:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862469.786905:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862469.786906:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862469.786907:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862469.786908:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862469.786909:0:15064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787862469.786934:0:15064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787862469.786955:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246480384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787862469.787072:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.787174:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480384 00000100:00100000:3.0:1787862469.787183:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480384 00000100:00100000:0.0:1787862469.787189:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13c3f6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.787834:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787862469.787848:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15064:x1874709246480384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787862469.787879:0:14377:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787862469.787894:0:14377:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787862469.806325:0:14377:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787862469.806363:0:14377:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787862469.806404:0:14399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787862469.806409:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787862469.806430:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.806448:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.806455:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.806490:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.806504:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 16 pid: 14376 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862469.806519:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874709246480512:0@lo:104: 00000100:00100000:1.0:1787862469.806583:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.806674:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a119297e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862469.806726:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480512 00000100:00100000:0.0:1787862469.806732:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480512 00000100:00100000:0.0:1787862469.806866:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862469.806877:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14399:x1874709246480512:12345-0@lo:104: 00010000:00010000:0.0:1787862469.806892:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.806955:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862469.806968:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14399:x1874709246480512:12345-0@lo:104: Request processed in 88us (378us total) trans 0 rc 0/0 00010000:00010000:3.0:1787862469.806970:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787862469.806979:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787862469.806982:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.806993:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9800 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862469.806997:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.807011:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862469.807019:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862469.807034:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862469.807090:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.807098:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862469.807124:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.807131:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a9800/0x391a6cd368cdac29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac30 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.807148:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862469.807150:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862469.807151:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862469.807167:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246480640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862469.807200:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.807255:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480640 00000100:00100000:1.0:1787862469.807261:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480640 00010000:00010000:1.0:1787862469.807284:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 17 pid: 14376 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862469.807311:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862469.807330:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:3330:x1874709246480640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862469.807343:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862469.807348:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 17 pid: 14376 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807355:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 17 pid: 14376 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807368:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807374:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787862469.807386:0:14368:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003425852s 00010000:00010000:1.0:1787862469.807389:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807394:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807399:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807403:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807416:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862469.807419:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807424:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807431:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.807441:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862469.807478:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:3330:x1874709246480640:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.807485:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787862469.807602:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdac30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdac29 expref: 16 pid: 14376 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862469.807613:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874709246480512:0@lo:104: 00010000:00010000:0.0:1787862469.807643:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.807653:0:14399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.807659:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.807665:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a8400/0x391a6cd368cdacc3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862469.807817:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246480640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862469.811684:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+15:15064:x1874709246480384:12345-0@lo:253:mount.lustre.0 Request processed in 23828us (24601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.811699:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862469.811787:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15064:1874709246480384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787862469.811804:0:15064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787862469.811807:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862469.811809:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862469.811810:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862469.811811:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862469.811813:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862469.811814:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862469.811815:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862469.811817:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862469.811819:0:15064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787862469.811839:0:15064:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787862469.818171:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862469.818298:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862469.818522:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862469.818951:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862469.819415:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862469.819598:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787862469.820149:0:15064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787862469.860782:0:15064:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787862469.860793:0:15064:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787862469.860824:0:15064:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787862469.860881:0:15064:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787862469.860897:0:15064:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787862469.860924:0:15064:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787862470.470354:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862471.429248:0:14380:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787862471.429259:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a104df9800 from 7 10000000:01000000:2.0:1787862471.429264:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862471.429322:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862471.429336:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862471.429349:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862471.429379:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246480768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862471.429464:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862471.429523:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105589600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862471.429708:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480768 00000100:00100000:0.0:1787862471.429717:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480768 00000100:00100000:0.0:1787862471.430087:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862471.430107:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+15:14380:x1874709246480768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862471.430137:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862471.430155:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdacca expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862471.430185:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdacca expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862471.430199:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdacca expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862471.430208:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e8800, rc 0) 00000100:00100000:0.0:1787862471.430262:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:14380:x1874709246480768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862471.430270:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787862471.430287:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246480768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862471.430317:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862471.430328:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862471.430381:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246480896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787862471.430422:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862471.430450:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a105589600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862471.430464:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246480896 00000100:00100000:0.0:1787862471.430471:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246480896 00000100:00100000:2.0:1787862471.430510:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787862471.430522:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:14380:x1874709246480896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787862471.430539:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787862471.430555:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787862471.430558:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787862471.431924:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:14380:x1874709246480896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1399us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862471.431938:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787862471.432326:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246480896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787862471.432396:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787862471.432406:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862471.432417:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862471.492705:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862472.516413:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862473.546572:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862474.567546:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862475.305387:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862475.305394:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787862475.305397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862475.305423:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787862475.306069:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246481024:0@lo:400:kworker.0 00000100:00100000:1.0:1787862475.306153:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862475.306227:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862475.306234:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246481152:0@lo:400:kworker.0 00000100:00100000:1.0:1787862475.306264:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862475.310194:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862475.310224:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246481280:0@lo:400:kworker.0 00000100:00100000:2.0:1787862475.310314:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862475.310367:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481152 00000100:00100000:2.0:1787862475.310375:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481152 00000100:00100000:2.0:1787862475.310431:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481280 00000100:00100000:2.0:1787862475.310434:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481280 00000100:00100000:2.0:1787862475.310466:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862475.310474:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246481152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862475.310756:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246481152:12345-0@lo:400:kworker.0 Request processed in 212us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862475.310765:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862475.310784:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862475.310791:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246481280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862475.310826:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246481280:12345-0@lo:400:kworker.0 Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862475.310832:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787862475.310892:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a006a94780 x1874709246481152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862475.310906:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246481152:0@lo:400:kworker.0 00010000:00080000:2.0:1787862475.310939:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a006a970c0 x1874709246481280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862475.310948:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246481280:0@lo:400:kworker.0 00000100:00080000:2.0:1787862475.310988:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862475.311391:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481024 00000100:00100000:0.0:1787862475.311397:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481024 00000100:00100000:0.0:1787862475.311590:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787862475.311599:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:3327:x1874709246481024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862475.311649:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:3327:x1874709246481024:12345-0@lo:400:kworker.0 Request processed in 52us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862475.311655:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862475.311934:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246481024:0@lo:400:kworker.0 00010000:00010000:1.0:1787862475.592063:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862476.036714:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787862476.613273:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862477.643912:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862477.723713:0:15431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787862478.662729:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862479.684998:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862480.005121:0:3326:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862464/real 1787862464] req@ffff89a006a95680 x1874709246476928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862480.005159:0:3326:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a006a95680 x1874709246476928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862480.005169:0:3326:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862464/real 1787862464] req@ffff89a006a97c00 x1874709246477056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862480.005182:0:3326:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a006a97c00 x1874709246477056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787862480.005203:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a112ba0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862480.005238:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787862480.005242:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246476928:0@lo:8:kworker.0 00000100:00080000:1.0:1787862480.005249:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862480.005255:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787862480.005258:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246477056:0@lo:8:kworker.0 00000100:00080000:3.0:1787862480.005402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862480.005413:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787862480.005416:0:37:0:(import.c:65:import_set_state_nolock()) ffff89a112ba0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862480.005421:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787862480.005426:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787862480.005432:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a112ba0000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862480.005453:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8e940 x1874709246481536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787862480.005482:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862480.005486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787862480.005488:0:37:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862480.005491:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787862480.005493:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787862480.005497:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a11c591800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862480.005510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8da40 x1874709246481664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862480.005558:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246481792:0@lo:400:kworker.0 00000100:00100000:3.0:1787862480.005637:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.005704:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862480.005710:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246481920:0@lo:400:kworker.0 00000100:00100000:3.0:1787862480.005739:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.005774:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481792 00000100:00100000:3.0:1787862480.005781:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481792 00000100:00100000:3.0:1787862480.005819:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481920 00000100:00100000:3.0:1787862480.005822:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481920 00000100:00100000:3.0:1787862480.005852:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862480.005861:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246481792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862480.005927:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246481792:12345-0@lo:400:kworker.0 Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862480.005935:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862480.005954:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862480.005960:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246481920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862480.005989:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246481920:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862480.005995:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787862480.006016:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862480.006027:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246481536:0@lo:8:kworker.0 00000100:00100000:3.0:1787862480.006087:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.006113:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246481664:0@lo:8:kworker.0 00000100:00100000:3.0:1787862480.006137:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.006166:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481536 00000100:00100000:3.0:1787862480.006170:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481536 00000100:00100000:3.0:1787862480.006183:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481664 00000100:00100000:3.0:1787862480.006185:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481664 00000100:00100000:3.0:1787862480.006194:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862480.006198:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3326:x1874709246481536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787862480.006233:0:15065:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1787862480.006265:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cdacd8 00002000:00100000:3.0:1787862480.006279:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a006aad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113978 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787862480.006283:0:15065:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787862480.006286:0:15065:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787862480.006652:0:15065:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787862480.006678:0:15065:0:(import.c:65:import_set_state_nolock()) ffff89a006aaa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862480.006728:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3326:x1874709246481536:12345-0@lo:8:kworker.0 Request processed in 528us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862480.006735:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862480.006751:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862480.006755:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3326:x1874709246481664:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787862480.006766:0:15065:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787862480.006791:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3326:x1874709246481664:12345-0@lo:8:kworker.0 Request processed in 34us (653us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787862480.006797:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787862480.006840:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13cb8f480 x1874709246481920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862480.006853:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246481920:0@lo:400:kworker.0 00010000:00080000:3.0:1787862480.006865:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13cb8cb40 x1874709246481792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862480.006873:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246481792:0@lo:400:kworker.0 00010000:00080000:3.0:1787862480.006905:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13cb8e940 x1874709246481536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862480.006914:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862480.006920:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787862480.006929:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787862480.006935:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787862480.006937:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a112ba0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787862480.006955:0:3326:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787862480.006960:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246481536:0@lo:8:kworker.0 00000100:00080000:3.0:1787862480.006972:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787862480.006981:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787862480.006985:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246481664:0@lo:8:kworker.0 00000004:00080000:3.0:1787862480.007034:0:14406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787862480.007082:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874709246482176:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787862480.007111:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.007128:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102efe240 going to sleep for 11 seconds 00000100:00100000:3.0:1787862480.007139:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482176 00000100:00100000:3.0:1787862480.007143:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482176 00000100:00100000:3.0:1787862480.007173:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862480.007179:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14406:x1874709246482176:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787862480.008447:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246481408:0@lo:400:kworker.0 00000100:00100000:0.0:1787862480.008526:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862480.008571:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862480.008577:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246482048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862480.008602:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787862480.008650:0:14405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787862480.009074:0:14405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 531044033126ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787862480.009103:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246481408 00000100:00100000:0.0:1787862480.009112:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246481408 00000100:00100000:0.0:1787862480.009155:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787862480.009164:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:3330:x1874709246481408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862480.009233:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:3330:x1874709246481408:12345-0@lo:400:kworker.0 Request processed in 59us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862480.009240:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787862480.009311:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246481408:0@lo:400:kworker.0 00000100:00100000:1.0:1787862480.010005:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482048 00000100:00100000:1.0:1787862480.010021:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482048 00000100:00100000:1.0:1787862480.010068:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862480.010078:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874709246482048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862480.010107:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862480.010157:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874709246482048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862480.010164:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787862480.011160:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13cb8da40 x1874709246482048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862480.011185:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246482048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862480.012681:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787862480.017576:0:15065:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787862480.017593:0:15065:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787862480.017601:0:15065:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1787862480.032004:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.032018:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.032036:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.032556:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.032564:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.032584:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.032596:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.032867:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.032960:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.033569:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.033576:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033588:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.033592:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.033596:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033717:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033727:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033735:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033752:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787862480.033764:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862480.033770:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033785:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862480.033789:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033800:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033816:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033822:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef9f352b/0x391a6cd368cdacdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033841:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862480.033845:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033850:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862480.033853:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033860:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033869:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033939:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c8b477a/0x391a6cd368cdace6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.033953:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.033955:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.033957:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.034397:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.034402:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.034411:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.034415:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.034419:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.034428:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.034435:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.034442:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.034456:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862480.034567:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.034573:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.034580:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.034583:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.034592:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.034720:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.034729:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83140ef/0x391a6cd368cdaced lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.034745:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.034747:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.034748:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.034786:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.036720:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.036730:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036746:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.036750:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.036756:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036769:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036778:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036785:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036812:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862480.036826:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862480.036832:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036839:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862480.036843:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036861:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036878:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036886:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014ac245a/0x391a6cd368cdacf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.036903:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.036905:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.036906:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.038580:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.038591:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039343:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.039350:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.039357:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039373:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039383:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039396:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039415:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862480.039430:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862480.039436:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039443:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030a00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862480.039448:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039456:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039484:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039491:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073ca39bf/0x391a6cd368cdacfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.039511:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.039513:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.039514:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.041290:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.041309:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041326:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.041330:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.041337:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041351:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041362:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041371:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041395:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862480.041411:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862480.041417:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041425:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030c00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862480.041429:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041438:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041965:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041975:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eaf8025/0x391a6cd368cdad02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.041997:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.042000:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.042001:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.044251:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.044263:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.044280:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.044285:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.044292:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.044305:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.044315:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.044323:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.044693:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.045308:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.045316:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.045328:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.045332:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.045336:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.045347:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.045356:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.045363:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046488:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862480.046499:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046510:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100030200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.046514:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046524:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046542:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046548:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098d10870/0x391a6cd368cdad09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046571:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.046575:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046581:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142161400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.046584:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046592:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046858:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.046866:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.046868:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.046870:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.048738:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.048751:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad813303/0x391a6cd368cdad10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.049761:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.049771:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.049794:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.049799:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.049806:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.049821:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.049831:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.049839:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.049864:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862480.050368:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.050376:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.050386:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.050390:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.050401:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.050421:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.050430:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.050432:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.050433:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.050810:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000376b76cb/0x391a6cd368cdad17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.050843:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787862480.053349:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787862480.053575:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.053585:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.053602:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.053741:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.053748:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.053777:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.053787:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.053794:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.053849:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.054554:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.054562:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.054573:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.054577:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.054581:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.054592:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.054600:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.054735:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055068:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862480.055076:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055096:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142161600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.055100:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055111:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055132:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055140:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005730e5b6/0x391a6cd368cdad1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055161:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.055164:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055171:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.055174:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055182:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055191:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.055207:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.055208:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.055211:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.055385:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.055390:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f644f71/0x391a6cd368cdad25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.056143:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.056150:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056161:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.056165:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.056170:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056180:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056187:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056194:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056234:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862480.056246:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862480.056250:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056257:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862480.056261:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056268:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056280:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056288:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de25ce17/0x391a6cd368cdad2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.056301:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.056302:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.056304:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.057161:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.057169:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057180:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.057190:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.057195:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057206:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057214:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057231:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057334:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.057772:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.057778:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057788:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.057791:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.057795:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057805:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057813:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.057827:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058238:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862480.058246:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058255:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160a00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.058259:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058269:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058290:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058311:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3da4f6/0x391a6cd368cdad33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058332:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862480.058336:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058343:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142161e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.058346:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058354:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058364:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058370:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.058372:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.058373:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.058436:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.058557:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.058563:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058de0ff0/0x391a6cd368cdad3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.058718:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.059195:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.059201:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.059213:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.059217:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.059232:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.059243:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.059250:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.059258:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.059285:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862480.059775:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.059782:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.059790:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142160400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.059794:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.059817:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.059831:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.059839:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036fc3370/0x391a6cd368cdad41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.059857:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.059859:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.059861:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.060801:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.060810:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.060824:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.060828:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.060834:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.060845:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.060854:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.060862:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.060972:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.061444:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.061450:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.061459:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.061544:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.061549:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.061559:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.061568:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.061575:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066722:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862480.066740:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066756:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a142161000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.066777:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066789:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066814:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066823:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fda7939/0x391a6cd368cdad48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066864:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862480.066881:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066887:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ca00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.066891:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066898:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066908:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.066916:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.066924:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.066926:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.073066:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.073083:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ebd6fd/0x391a6cd368cdad4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.074863:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.075694:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.075714:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.075719:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.075725:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.075741:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.075759:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.075766:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.075836:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862480.075845:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.075854:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2cc00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.075858:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.075868:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.075896:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.075906:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.075907:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.075909:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.078009:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.078025:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdad56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.081006:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.081020:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.081038:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.081059:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.081065:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.081080:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.081089:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.081109:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.081628:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862480.081638:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.081647:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.081652:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.081661:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.081689:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.081699:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.081701:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862480.081702:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.081818:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.081824:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3919b1f/0x391a6cd368cdad5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.082383:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.082390:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.082401:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.082405:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.082409:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.082418:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.082426:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.082432:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.086721:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862480.086741:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.086758:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.086764:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.086777:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.086803:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.087027:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.087036:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9f94780/0x391a6cd368cdad64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.087984:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862480.088846:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.088857:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.089003:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.089006:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.089008:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.089035:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.089593:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.089603:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.089706:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.089719:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.089728:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.090918:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.091611:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.091621:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.091645:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.091649:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.091656:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.091670:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.091679:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.091686:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.093747:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862480.093761:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.093775:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862480.093794:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.093807:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.093829:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.093836:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fb1a929/0x391a6cd368cdad6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.094066:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.094072:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.094089:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2de00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.094092:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.094101:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.094113:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.094121:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.094123:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.094125:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.096594:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.098080:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a8c81d/0x391a6cd368cdad72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.098838:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.098847:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.098861:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.098866:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.098883:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.098935:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.098945:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.098953:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.100958:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862480.100973:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.100986:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862480.101009:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.101021:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.101068:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.101081:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.101083:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.101085:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.101641:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.101650:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e5a3d1/0x391a6cd368cdad79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.102355:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.102363:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.102378:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.102382:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.102389:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.102402:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.102422:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.102429:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.111171:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862480.111192:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.111208:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862480.111213:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.111235:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.111261:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.111292:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.111315:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.111318:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.111547:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.111715:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.111723:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdad80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862480.113844:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.113857:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.113944:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.113950:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.113957:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.113972:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.113984:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.114006:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.114217:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862480.116351:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862480.116363:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.116382:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=531s v=(0 0) 00010000:00010000:3.0:1787862480.116386:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862480.116391:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.116405:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.116415:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862480.116422:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.120008:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862480.120025:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.120066:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ce00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862480.120071:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.120082:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.120108:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.120115:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff28010/0x391a6cd368cdad87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.120921:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862480.120930:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.120939:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862480.120942:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.120951:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.120965:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.120994:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.120995:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.120998:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862480.124279:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862480.124296:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011cd81e0/0x391a6cd368cdad8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862480.125575:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862480.125586:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.125603:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1787862480.125790:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862480.125800:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.125815:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.125826:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.125834:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.126341:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862480.126350:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.126359:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862480.126363:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.126388:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.126406:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.126416:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.126418:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.126420:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.126571:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787862480.126577:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838e8968/0x391a6cd368cdad95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862480.127855:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862480.127996:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862480.128010:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.128024:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1787862480.128029:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862480.128035:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.128305:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.128315:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.128322:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.128374:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787862480.128695:0:15065:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1787862480.128841:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14406:x1874709246482176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 121657us (121724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862480.128856:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787862480.129161:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862480.129169:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.129178:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8a00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862480.129182:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.129191:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.129208:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862480.129215:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9825a16/0x391a6cd368cdad9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862480.129367:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.129370:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862480.129371:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862480.129437:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874709246482176:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787862480.129454:0:14406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787862480.129571:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874709246482304:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787862480.129717:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.129801:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102efe240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862480.129848:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482304 00000100:00100000:0.0:1787862480.129854:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482304 00000100:00100000:0.0:1787862480.129996:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862480.130006:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14406:x1874709246482304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787862480.131003:0:15068:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1787862480.145349:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14406:x1874709246482304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15336us (15624us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787862480.145364:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862480.147374:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874709246482304:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787862480.147396:0:14406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:2.0:1787862480.560007:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787862480.560104:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787862480.712511:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862481.738169:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862482.756770:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862483.780402:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862484.805783:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787862485.508778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862485.508785:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787862485.508789:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862485.508797:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:3.0:1787862485.508803:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787862485.508811:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a11c591800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862485.508837:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13cb8c3c0 x1874709246482688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862485.508887:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246482432:0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.508966:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862485.509026:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862485.509033:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246482944:0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509081:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862485.509111:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246482560:0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509276:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862485.509304:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862485.509310:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246482816:0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509353:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862485.509381:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246482688:0@lo:8:kworker.0 00000100:00100000:3.0:1787862485.509404:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862485.509430:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482432 00000100:00100000:3.0:1787862485.509436:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482432 00000100:00100000:3.0:1787862485.509474:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787862485.509481:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+16:3330:x1874709246482432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509523:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+16:3330:x1874709246482432:12345-0@lo:400:kworker.0 Request processed in 42us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862485.509530:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787862485.509558:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482944 00000100:00100000:3.0:1787862485.509561:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482944 00000100:00100000:3.0:1787862485.509589:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482816 00000100:00100000:3.0:1787862485.509591:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482816 00000100:00100000:3.0:1787862485.509601:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862485.509606:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246482944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509634:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246482944:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862485.509640:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862485.509650:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862485.509655:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509679:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246482816:12345-0@lo:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862485.509684:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862485.509703:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482560 00000100:00100000:3.0:1787862485.509705:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482560 00000100:00100000:3.0:1787862485.509724:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246482688 00000100:00100000:3.0:1787862485.509731:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246482688 00000100:00100000:3.0:1787862485.509742:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862485.509747:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246482560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862485.509773:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246482560:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862485.509778:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862485.509787:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862485.509791:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3326:x1874709246482688:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787862485.509807:0:15067:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787862485.514392:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13cb8cf00 x1874709246482816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862485.514413:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246482816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862485.514426:0:3327:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787862485.514497:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246482560:0@lo:400:kworker.0 00000100:00080000:2.0:1787862485.514536:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862485.514542:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862485.514556:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246483072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862485.514624:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787862485.515289:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13cb8da40 x1874709246482944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862485.515311:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246482944:0@lo:400:kworker.0 00000100:00100000:2.0:1787862485.515325:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246482432:0@lo:400:kworker.0 00000100:00100000:1.0:1787862485.520476:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483072 00000100:00100000:1.0:1787862485.520492:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483072 00000100:00100000:1.0:1787862485.520555:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862485.520566:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246483072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862485.520607:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862485.523084:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246483072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2512us (8451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862485.523100:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862485.526077:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246483072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862485.581014:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3326:x1874709246482688:12345-0@lo:8:kworker.0 Request processed in 71214us (71602us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787862485.581034:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787862485.581162:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862485.581178:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787862485.581183:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246482688:0@lo:8:kworker.0 00010000:00010000:1.0:1787862485.832600:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862486.279366:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787862486.853838:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862487.881171:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787862488.780601:0:15784:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787862488.780606:0:15784:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787862488.780750:0:15784:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89a13ee4c800 00000020:01000004:2.0:1787862488.780767:0:15784:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787862488.780782:0:15784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787862488.780940:0:15784:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89a111029a48) 00000020:00000080:2.0:1787862488.780962:0:15784:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787862488.818545:0:15784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787862488.820400:0:15784:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787862488.823148:0:15784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787862488.823408:0:15784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787862488.825000:0:15784:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787862488.825498:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 203: rc = 0 00100000:10000000:3.0:1787862488.826566:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 203: rc = 0 00100000:10000000:3.0:1787862488.827162:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 203: rc = 0 00100000:10000000:3.0:1787862488.828026:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 584: rc = 0 00100000:10000000:3.0:1787862488.828363:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 584: rc = 0 00100000:10000000:3.0:1787862488.829123:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 584: rc = 0 00100000:10000000:3.0:1787862488.829396:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 584: rc = 0 00100000:10000000:3.0:1787862488.829655:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 584: rc = 0 00100000:10000000:3.0:1787862488.830113:0:15784:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 584: rc = 0 00000020:00000080:3.0:1787862488.831025:0:15784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787862488.831065:0:15784:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787862488.831085:0:15784:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x391a6cd368cdadaa 00000020:01000004:3.0:1787862488.831094:0:15784:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787862488.831120:0:15784:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787862488.831124:0:15784:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787862488.831130:0:15784:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787862488.831165:0:15784:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787862488.831170:0:15784:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787862488.850578:0:15784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787862488.850616:0:15784:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.109@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787862488.850621:0:15784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787862488.850623:0:15784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787862488.850624:0:15784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862488.850626:0:15784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862488.850627:0:15784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862488.851099:0:15784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862488.851102:0:15784:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862488.851104:0:15784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862488.851105:0:15784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787862488.851110:0:15784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787862488.851112:0:15784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787862488.851114:0:15784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787862488.851115:0:15784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862488.851116:0:15784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862488.851117:0:15784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862488.851118:0:15784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862488.851125:0:15784:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862488.851126:0:15784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862488.851127:0:15784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787862488.851186:0:15784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787862488.851212:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483200:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787862488.851292:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862488.851420:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483200 00000100:00100000:0.0:1787862488.851428:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483200 00000100:00100000:1.0:1787862488.851463:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.857777:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787862488.857814:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15784:x1874709246483200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787862488.857870:0:14376:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787862488.857873:0:14376:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787862488.857878:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787862488.879749:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15784:x1874709246483200:12345-0@lo:253:mount.lustre.0 Request processed in 21951us (28447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.879763:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862488.880161:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483200:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787862488.880177:0:15784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787862488.880181:0:15784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787862488.880182:0:15784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787862488.880184:0:15784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862488.880186:0:15784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862488.880187:0:15784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862488.880188:0:15784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862488.880190:0:15784:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862488.880192:0:15784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862488.880193:0:15784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787862488.880212:0:15784:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a13ee4c800 from lustre-OST0001 10000000:01000000:1.0:1787862488.880247:0:15784:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787862488.880250:0:15784:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787862488.880257:0:15784:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a0055b0000 local copy 00010000:00010000:1.0:1787862488.880269:0:15784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862488.880494:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862488.880536:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.880581:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862488.880765:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483328 00000100:00100000:2.0:1787862488.880948:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483328 00000100:00100000:2.0:1787862488.881001:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862488.881011:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15784:x1874709246483328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862488.886725:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15784:x1874709246483328:12345-0@lo:501:mount.lustre.0 Request processed in 5702us (6175us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862488.886742:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787862488.886879:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483328:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787862488.886907:0:15784:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787862488.887123:0:15784:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787862488.887151:0:15784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.887163:0:15784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a9200/0x391a6cd368cdab50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdab57 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862488.887193:0:15784:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a13ee4c800 10000000:01000000:1.0:1787862488.887197:0:15784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787862488.887204:0:15784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787862488.887206:0:15784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862488.887211:0:15784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787862488.887214:0:15784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787862488.887249:0:15784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.887258:0:15784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.887268:0:15784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862488.887288:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787862488.887330:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.887413:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.889060:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483456 00000100:00100000:0.0:1787862488.889088:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483456 00000100:00100000:0.0:1787862488.889168:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787862488.889180:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+16:15784:x1874709246483456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862488.889199:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862488.889220:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e9200/0x391a6cd368cdadb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdadb1 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.889250:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9200/0x391a6cd368cdadb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdadb1 expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.889262:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e9200/0x391a6cd368cdadb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdadb1 expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.889272:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9200, rc 0) 00000100:00100000:0.0:1787862488.889340:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483456:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.889347:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787862488.889480:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862488.889499:0:15784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdadb8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.889508:0:15784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdadb8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862488.890602:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787862488.891534:0:15784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862488.891764:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787862488.891809:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787862488.891843:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787862488.891898:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787862488.891932:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787862488.891963:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787862488.892024:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787862488.892031:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787862488.892518:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862488.892595:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.892685:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862488.892902:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483584 00000100:00100000:3.0:1787862488.892910:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483584 00000100:00100000:3.0:1787862488.893013:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787862488.893022:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862488.893486:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483584:12345-0@lo:501:mount.lustre.0 Request processed in 464us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862488.893494:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787862488.893588:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862488.893625:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862488.893665:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.895352:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.895404:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483712 00000100:00100000:0.0:1787862488.895411:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483712 00000100:00100000:0.0:1787862488.895457:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787862488.895466:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862488.896113:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483712:12345-0@lo:503:mount.lustre.0 Request processed in 646us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.896123:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787862488.896693:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787862488.897646:0:15784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862488.897748:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862488.899132:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.899262:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862488.901732:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483840 00000100:00100000:2.0:1787862488.901745:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483840 00000100:00100000:2.0:1787862488.901975:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862488.901988:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862488.902373:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483840:12345-0@lo:502:mount.lustre.0 Request processed in 387us (3244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862488.902383:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787862488.902487:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862488.902807:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787862488.902872:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787862488.902919:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787862488.902968:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787862488.903006:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787862488.903061:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787862488.903118:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787862488.903171:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787862488.903221:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787862488.903263:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862488.903321:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.907586:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.909295:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246483968 00000100:00100000:0.0:1787862488.909309:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246483968 00000100:00100000:0.0:1787862488.909372:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862488.909383:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862488.909749:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246483968:12345-0@lo:502:mount.lustre.0 Request processed in 368us (6428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.909758:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787862488.909945:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246483968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862488.910085:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787862488.910102:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787862488.911950:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787862488.911961:0:15786:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787862488.911968:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862488.911970:0:15786:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787862488.911975:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787862488.911989:0:15786:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89a13f9a0000) 00000020:00000080:0.0:1787862488.912011:0:15786:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787862488.912018:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787862488.912113:0:15786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a13ee4c800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787862488.912121:0:15786:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787862488.912129:0:15786:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x391a6cd368cdadc6 00010000:00010000:1.0:1787862488.916717:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862488.919722:0:15786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787862488.920362:0:15786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787862488.927912:0:15786:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1787862488.929798:0:15786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787862488.929812:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862488.929819:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862488.929830:0:15786:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787862488.929834:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862488.929839:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862488.929840:0:15786:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787862488.929843:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787862488.929845:0:15786:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787862488.929847:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862488.929850:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862488.929851:0:15786:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787862488.929853:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862488.929855:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862488.929856:0:15786:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787862488.929859:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787862488.929894:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862488.929898:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862488.929900:0:15786:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787862488.929903:0:15786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787862488.931887:0:15784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787862488.931925:0:15784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787862488.937640:0:15784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdadb8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.937660:0:15784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8e00/0x391a6cd368cdadb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdadb8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862488.937668:0:15784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a13ee4c800 from 1 10000000:01000000:1.0:1787862488.937672:0:15784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862488.937707:0:15784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.937714:0:15784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.937736:0:15784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862488.937759:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787862488.937837:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.937892:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.938002:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484096 00000100:00100000:0.0:1787862488.938009:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484096 00000100:00100000:0.0:1787862488.938087:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862488.938097:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:15784:x1874709246484096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862488.938109:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862488.938123:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdadcd expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.938157:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.938168:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.938184:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9400, rc 0) 00000100:00100000:0.0:1787862488.938223:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484096:12345-0@lo:101:mount.lustre.0 Request processed in 128us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.938230:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787862488.940511:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862488.940543:0:15784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862488.940555:0:15784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862488.941148:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787862488.941462:0:15784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862488.941675:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787862488.941720:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787862488.941806:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787862488.941816:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787862488.941879:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862488.941940:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.941986:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.942676:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484224 00000100:00100000:0.0:1787862488.942685:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484224 00000100:00100000:0.0:1787862488.942737:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862488.942747:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862488.943215:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484224:12345-0@lo:501:mount.lustre.0 Request processed in 468us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.943224:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787862488.943360:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862488.943400:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862488.943444:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.943479:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862488.943534:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484352 00000100:00100000:2.0:1787862488.943539:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484352 00000100:00100000:2.0:1787862488.943573:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862488.943581:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862488.943922:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484352:12345-0@lo:503:mount.lustre.0 Request processed in 341us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862488.943928:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787862488.944174:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484352:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787862488.944651:0:15784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862488.944718:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862488.944923:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.944963:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862488.945066:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484480 00000100:00100000:2.0:1787862488.945072:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484480 00000100:00100000:2.0:1787862488.945105:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787862488.945114:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862488.945316:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484480:12345-0@lo:502:mount.lustre.0 Request processed in 203us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862488.945324:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787862488.946308:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862488.946586:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787862488.947394:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787862488.947470:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787862488.947511:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787862488.947547:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787862488.947598:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787862488.948001:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787862488.948089:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787862488.948371:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862488.948454:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862488.948538:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862488.953845:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484608 00000100:00100000:2.0:1787862488.953872:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484608 00000100:00100000:2.0:1787862488.953943:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787862488.953954:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862488.954311:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484608:12345-0@lo:502:mount.lustre.0 Request processed in 358us (5856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862488.954319:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862488.954793:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862488.954979:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787862488.954998:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787862488.956178:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862488.956190:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862488.956193:0:15790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787862488.956199:0:15790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a13ee4c800 00000020:00000080:3.0:1787862488.956202:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862488.956209:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862488.956211:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862488.956212:0:15790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787862488.956214:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862488.956217:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862488.956218:0:15790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787862488.956221:0:15790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a13ee4c800 00000020:00000080:3.0:1787862488.956223:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862488.956278:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862488.956288:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862488.956290:0:15790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787862488.956292:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862488.956295:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862488.956296:0:15790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787862488.956300:0:15790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89a13ee4c800 00000020:00000080:3.0:1787862488.956302:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862488.956339:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862488.956342:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862488.956344:0:15790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787862488.956346:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787862488.962392:0:15784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787862488.962445:0:15784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862488.962470:0:15784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862488.962484:0:15784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862488.962537:0:15784:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787862488.962541:0:15784:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a13ee4c800 10000000:01000000:2.0:1787862488.962544:0:15784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a13ee4c800 10000000:01000000:2.0:1787862488.962548:0:15784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862488.962554:0:15784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89a13ee4c800 from 1 10000000:01000000:2.0:1787862488.962557:0:15784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862488.962597:0:15784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862488.962606:0:15784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862488.962618:0:15784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862488.962660:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862488.962738:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862488.962780:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862488.974242:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484736 00000100:00100000:0.0:1787862488.974258:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484736 00000100:00100000:0.0:1787862488.974328:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787862488.974338:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246484736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862488.974355:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862488.974375:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdade2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdaddb expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.974404:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdade2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdaddb expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.974416:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1420e9800/0x391a6cd368cdade2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdaddb expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862488.974426:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1420e9800, rc 0) 00000100:00100000:0.0:1787862488.974525:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246484736:12345-0@lo:101:mount.lustre.0 Request processed in 188us (11787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.974532:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862488.977445:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862488.977475:0:15784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdade2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862488.977489:0:15784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdade2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862488.978169:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787862488.978685:0:15784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862488.978914:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787862488.978970:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787862488.979004:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787862488.979076:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787862488.979113:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787862488.979167:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787862488.979198:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787862488.979224:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787862488.979262:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787862488.979290:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787862488.979316:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787862488.979352:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787862488.979379:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787862488.979404:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787862488.979440:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787862488.979467:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787862488.979494:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787862488.979552:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787862488.979582:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787862488.979608:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787862488.979644:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787862488.979672:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787862488.979697:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787862488.979733:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787862488.979760:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787862488.979786:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787862488.979831:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787862488.979863:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787862488.979898:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787862488.979944:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787862488.979979:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787862488.980013:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787862488.980073:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787862488.988309:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787862488.988438:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787862488.988523:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787862488.988563:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787862488.988663:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787862488.988671:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787862488.988776:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862488.990001:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862488.990132:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484864 00000100:00100000:0.0:1787862488.990149:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484864 00000100:00100000:0.0:1787862488.990199:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862488.990209:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246484864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862488.990471:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246484864:12345-0@lo:501:mount.lustre.0 Request processed in 263us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862488.990480:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862488.990889:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862488.990914:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862488.990964:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862488.991009:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862488.991107:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1034ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1787862488.994030:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246484992 00000100:00100000:3.0:1787862488.994057:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246484992 00000100:00100000:3.0:1787862488.994110:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787862488.994121:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a111020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246484992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862488.994558:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a111020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246484992:12345-0@lo:503:mount.lustre.0 Request processed in 438us (3548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862488.994567:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862488.995155:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246484992:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787862488.995713:0:15784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787862488.995811:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246485120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862488.995876:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862488.995949:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862488.996320:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485120 00000100:00100000:1.0:1787862488.996326:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485120 00000100:00100000:1.0:1787862488.996370:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787862488.996380:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246485120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862488.996649:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246485120:12345-0@lo:502:mount.lustre.0 Request processed in 270us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862488.996656:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862488.996752:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246485120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787862488.997316:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787862488.997371:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787862488.997409:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787862488.997459:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787862488.997499:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787862488.997566:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787862488.997607:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787862488.997643:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787862488.997690:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787862488.997728:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787862488.997764:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787862488.998563:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787862488.998616:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787862488.998656:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787862488.998706:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787862488.998745:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787862488.998783:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787862488.999006:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787862488.999207:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787862488.999248:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787862488.999297:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787862488.999330:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787862488.999360:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787862488.999410:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787862488.999462:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787862488.999512:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787862488.999561:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787862488.999596:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787862488.999630:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787862488.999679:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787862488.999717:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787862488.999750:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787862488.999782:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787862489.000080:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787862489.000121:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787862489.000196:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787862489.000234:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787862489.000268:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787862489.000312:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787862489.000345:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787862489.000394:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246485248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862489.000473:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862489.000514:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e76d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862489.001007:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485248 00000100:00100000:1.0:1787862489.001015:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485248 00000100:00100000:1.0:1787862489.001096:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787862489.001107:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246485248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862489.001383:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246485248:12345-0@lo:502:mount.lustre.0 Request processed in 277us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.001391:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787862489.002121:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246485248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787862489.002251:0:15784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787862489.002266:0:15784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787862489.008288:0:15795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787862489.008314:0:15795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89a13f9a4ed8) 00000020:00000080:0.0:1787862489.008335:0:15795:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787862489.009090:0:15795:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a13ee4c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787862489.009096:0:15795:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a13ee4c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787862489.009099:0:15795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a13ee4c800 3 00010000:00080000:0.0:1787862489.009132:0:15795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a0082cd000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.109@tcp at head 00010000:00010000:1.0:1787862489.012634:0:15795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787862489.013888:0:15795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787862489.013937:0:15795:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787862489.013951:0:15795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x391a6cd368cdadf0 00000100:00080000:1.0:1787862489.013962:0:15795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787862489.013969:0:15795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a0082cd000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1787862489.014008:0:15795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a006a96940 x1874709246485376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787862489.014057:0:15795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787862489.014336:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787862489.015737:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246485376:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787862489.015848:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787862489.015952:0:15784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787862489.015985:0:15784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862489.016005:0:15784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdade2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.016016:0:15784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79ea00/0x391a6cd368cdaddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdade2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787862489.016090:0:15784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787862489.016096:0:15784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787862489.016097:0:15784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862489.016098:0:15784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862489.016099:0:15784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862489.016101:0:15784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862489.016102:0:15784:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862489.016104:0:15784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862489.016105:0:15784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787862489.016110:0:15784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787862489.016112:0:15784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787862489.016113:0:15784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787862489.016114:0:15784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862489.016115:0:15784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862489.016116:0:15784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862489.016117:0:15784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862489.016118:0:15784:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862489.016119:0:15784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862489.016120:0:15784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787862489.016153:0:15784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787862489.016169:0:15784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246485504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787862489.016208:0:15784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862489.016239:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485504 00000100:00100000:3.0:1787862489.016246:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485504 00000100:00100000:3.0:1787862489.016295:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787862489.016304:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:15784:x1874709246485504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787862489.016346:0:14378:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787862489.016361:0:14378:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787862489.016776:0:15784:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c87540 going to sleep for 11 seconds 00000100:00080000:3.0:1787862489.017159:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862489.017163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787862489.017166:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862489.017172:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1787862489.017176:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787862489.017180:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a11c591800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1787862489.017208:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13c42d680 x1874709246485760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862489.017260:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246485888:0@lo:400:kworker.0 00000100:00100000:3.0:1787862489.017303:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862489.017330:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862489.017335:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246485632:0@lo:400:kworker.0 00000100:00100000:3.0:1787862489.017360:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862489.017388:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485376 00000100:00100000:3.0:1787862489.017393:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485376 00000100:00100000:3.0:1787862489.017416:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485888 00000100:00100000:3.0:1787862489.017419:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485888 00000100:00100000:3.0:1787862489.017442:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862489.017450:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246485888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862489.017574:0:14385:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787862489.017582:0:14385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787862489.017655:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862489.017667:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246486016:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.017700:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862489.019331:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246485888:12345-0@lo:400:kworker.0 Request processed in 1872us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862489.019346:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862489.019382:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486016 00000100:00100000:3.0:1787862489.019389:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486016 00000100:00100000:3.0:1787862489.019433:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862489.019441:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246486016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862489.019489:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246486016:12345-0@lo:400:kworker.0 Request processed in 49us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862489.019495:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862489.019507:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862489.019511:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3326:x1874709246485376:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787862489.019532:0:14384:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1787862489.019578:0:14384:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x391a6cd368cdadf7 00000004:00100000:3.0:1787862489.019593:0:14384:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787862489.019623:0:14384:0:(import.c:65:import_set_state_nolock()) ffff89a006aa8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862489.019658:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874709246485376:12345-0@lo:38:llog_process_th.0 Request processed in 145us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862489.019664:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787862489.019708:0:3328:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13c42da40 x1874709246485888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862489.019723:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246485888:0@lo:400:kworker.0 00000100:00100000:3.0:1787862489.019751:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246485760:0@lo:8:kworker.0 00000100:00100000:3.0:1787862489.019783:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787862489.019812:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a006a96940 x1874709246485376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862489.019821:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862489.019828:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787862489.019835:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787862489.019840:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787862489.019842:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a0082cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787862489.019848:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3326:1874709246485376:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787862489.019927:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89a13c42cb40 x1874709246486016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862489.019938:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246486016:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.019964:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485632 00000100:00100000:1.0:1787862489.019968:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485632 00000100:00100000:1.0:1787862489.020221:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246485760 00000100:00100000:1.0:1787862489.020226:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246485760 00000100:00100000:0.0:1787862489.020622:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862489.020632:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246485632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862489.020687:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246485632:12345-0@lo:400:kworker.0 Request processed in 57us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862489.020692:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862489.020707:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862489.020710:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3326:x1874709246485760:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787862489.020747:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3326:x1874709246485760:12345-0@lo:8:kworker.0 Request processed in 34us (963us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787862489.020753:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862489.020812:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246485632:0@lo:400:kworker.0 00000100:00100000:3.0:1787862489.020838:0:3326:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862489.020842:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787862489.020846:0:3326:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787862489.020849:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246485760:0@lo:8:kworker.0 00000100:00080000:2.0:1787862489.023423:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862489.023435:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1787862489.073886:0:14378:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787862489.073908:0:14378:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787862489.073974:0:14399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787862489.073980:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787862489.074024:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862489.074072:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdacca expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862489.074081:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862489.074124:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdacca expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862489.074159:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdacca expref: 19 pid: 14376 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862489.074176:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcd2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874709246486144:0@lo:104: 00000100:00100000:0.0:1787862489.074263:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862489.074309:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a102aeb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862489.074996:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486144 00000100:00100000:3.0:1787862489.075006:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486144 00000100:00100000:3.0:1787862489.075088:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862489.075098:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14399:x1874709246486144:12345-0@lo:104: 00010000:00010000:3.0:1787862489.075113:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075201:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862489.075208:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:14399:x1874709246486144:12345-0@lo:104: Request processed in 112us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862489.075214:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787862489.075238:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862489.075244:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075251:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fa00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:3.0:1787862489.075255:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075264:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862489.075272:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862489.075278:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862489.075310:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075326:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862489.075348:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075356:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a13d79fa00/0x391a6cd368cdacca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdacd1 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075373:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862489.075374:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862489.075376:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862489.075397:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246486272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862489.075429:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862489.075477:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486272 00000100:00100000:3.0:1787862489.075482:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486272 00010000:00010000:3.0:1787862489.075499:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdacca expref: 20 pid: 14376 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862489.075524:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862489.075531:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+20:3330:x1874709246486272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862489.075541:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862489.075547:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdacca expref: 20 pid: 14376 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075558:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdacca expref: 20 pid: 14376 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075575:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075595:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787862489.075609:0:14368:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003425852s 00010000:00010000:3.0:1787862489.075614:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075621:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075629:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075636:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075642:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862489.075647:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075655:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075664:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862489.075674:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862489.075703:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+20:3330:x1874709246486272:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862489.075710:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862489.075756:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246486272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862489.075835:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1420e8800/0x391a6cd368cdacd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdacca expref: 19 pid: 14376 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862489.075848:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcd2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874709246486144:0@lo:104: 00010000:00010000:1.0:1787862489.075875:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862489.075885:0:14399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862489.075892:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862489.075899:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13ee8b000/0x391a6cd368cdadfe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862489.082274:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:15784:x1874709246485504:12345-0@lo:253:mount.lustre.0 Request processed in 65960us (66053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862489.082290:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787862489.082383:0:15784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079ae7a9-a8cb-4160-870b-e99ad994d115:15784:1874709246485504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787862489.082400:0:15784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787862489.082404:0:15784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787862489.082406:0:15784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787862489.082408:0:15784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862489.082409:0:15784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862489.082411:0:15784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862489.082412:0:15784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862489.082414:0:15784:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862489.082416:0:15784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862489.082417:0:15784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787862489.082438:0:15784:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787862489.090664:0:15784:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862489.091694:0:15784:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787862489.091991:0:15784:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862489.092342:0:15784:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787862489.092558:0:15784:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862489.092700:0:15784:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787862489.093849:0:15784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787862489.165743:0:15784:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787862489.165753:0:15784:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787862489.166107:0:15784:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787862489.166186:0:15784:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787862489.166206:0:15784:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787862489.166429:0:15784:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787862489.924270:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787862490.378645:0:14380:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787862490.378653:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89a104df9800 from 8 10000000:01000000:0.0:1787862490.378659:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787862490.378711:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862490.378724:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862490.378736:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862490.378763:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246486400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862490.378832:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862490.378896:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c09240 going to sleep for 11 seconds 00000100:00100000:1.0:1787862490.378921:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486400 00000100:00100000:1.0:1787862490.378928:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486400 00000100:00100000:1.0:1787862490.378984:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787862490.378995:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246486400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862490.379008:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862490.379022:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a8a00/0x391a6cd368cdae0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdae05 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862490.379077:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a8a00/0x391a6cd368cdae0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdae05 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862490.379088:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a8a00/0x391a6cd368cdae0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdae05 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862490.379110:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a8a00, rc 0) 00000100:00100000:1.0:1787862490.379608:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246486400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 614us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862490.379617:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787862490.385570:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246486400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862490.385600:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdae0c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862490.385614:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdae0c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862490.385833:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246486528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787862490.385899:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862490.385941:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a119297180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862490.385999:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486528 00000100:00100000:0.0:1787862490.386006:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486528 00000100:00100000:0.0:1787862490.386075:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787862490.386084:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246486528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787862490.386108:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787862490.386122:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787862490.386136:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787862490.386234:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246486528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862490.386243:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787862490.387938:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246486528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787862490.388017:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862490.388027:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdae0c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862490.388037:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13ee8be00/0x391a6cd368cdae05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdae0c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862490.629450:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862490.629480:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c42d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246486656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862490.629565:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862490.629632:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486656 00000100:00100000:3.0:1787862490.629640:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486656 00000100:00100000:3.0:1787862490.629687:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862490.629697:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246486656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862490.629730:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862490.629785:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246486656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862490.629793:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862490.629843:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c42d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246486656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862490.949462:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862491.979307:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862492.996566:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.021224:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787862494.214268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862494.214277:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787862494.214281:0:37:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787862494.214297:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a11c591800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1787862494.214327:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a13d0b8b40 x1874709246487040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862494.214425:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246487296:0@lo:400:kworker.0 00000100:00100000:2.0:1787862494.214521:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862494.214598:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862494.214605:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246486784:0@lo:400:kworker.0 00000100:00100000:2.0:1787862494.214643:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862494.214672:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246487424:0@lo:400:kworker.0 00000100:00100000:2.0:1787862494.214702:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862494.214738:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486784 00000100:00100000:2.0:1787862494.214748:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486784 00000100:00100000:2.0:1787862494.214822:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787862494.214834:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246486784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862494.214904:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246486784:12345-0@lo:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862494.214913:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787862494.218311:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246486912:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.218503:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.218905:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862494.218916:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246487168:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.218954:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.218994:0:3326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246487040:0@lo:8:kworker.0 00000100:00100000:3.0:1787862494.219026:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.219108:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487296 00000100:00100000:3.0:1787862494.219118:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487296 00000100:00100000:2.0:1787862494.219358:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246486784:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.219386:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487424 00000100:00100000:3.0:1787862494.219390:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487424 00000100:00100000:2.0:1787862494.219443:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246486912 00000100:00100000:2.0:1787862494.219447:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246486912 00000100:00080000:0.0:1787862494.219937:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862494.219943:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862494.220285:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487168 00000100:00100000:3.0:1787862494.220291:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487168 00000100:00100000:3.0:1787862494.220313:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787862494.220890:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246487296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.221444:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246487296:12345-0@lo:400:kworker.0 Request processed in 1118us (6920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862494.221455:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787862494.225636:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0b8780 x1874709246487296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862494.225661:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246487296:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.226519:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787862494.226721:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246487424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.226915:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246487424:12345-0@lo:400:kworker.0 Request processed in 380us (12209us total) trans 0 rc 0/0 00010000:00080000:1.0:1787862494.227148:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0ba580 x1874709246487424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862494.227178:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246487424:0@lo:400:kworker.0 00000100:00100000:2.0:1787862494.227607:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862494.227632:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246487168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.227645:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862494.227726:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246487168:12345-0@lo:400:kworker.0 Request processed in 106us (8770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862494.227737:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787862494.228077:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0ba940 x1874709246487168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862494.228103:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246487168:0@lo:400:kworker.0 00000100:00100000:0.0:1787862494.228342:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487040 00000100:00100000:0.0:1787862494.228603:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487040 00000100:00100000:0.0:1787862494.228642:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862494.228648:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3326:x1874709246487040:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787862494.228681:0:15067:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1787862494.229104:0:15067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x391a6cd368cdae13 00002000:00100000:0.0:1787862494.229121:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a0082cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113978 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787862494.229126:0:15067:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787862494.229129:0:15067:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787862494.229599:0:15065:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787862494.229611:0:15065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1787862494.230000:0:15067:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787862494.230074:0:15067:0:(import.c:65:import_set_state_nolock()) ffff89a0082cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862494.230191:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3326:x1874709246487040:12345-0@lo:8:kworker.0 Request processed in 1540us (11162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862494.230201:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862494.230226:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862494.230236:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246486912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862494.230279:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246486912:12345-0@lo:400:kworker.0 Request processed in 46us (11776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862494.230286:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787862494.232425:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a13d0b8b40 x1874709246487040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787862494.232456:0:3326:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787862494.232469:0:3326:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787862494.232476:0:3326:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787862494.232481:0:3326:0:(import.c:65:import_set_state_nolock()) ffff89a11c591800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787862494.232500:0:3326:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787862494.232509:0:3326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3326:1874709246487040:0@lo:8:kworker.0 00000004:00080000:0.0:1787862494.232599:0:14408:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787862494.232629:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874709246487680:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787862494.232711:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862494.233213:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c09540 going to sleep for 11 seconds 00000004:00080000:0.0:1787862494.233238:0:14407:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787862494.237121:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862494.237150:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246487552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862494.237255:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862494.237346:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246486912:0@lo:400:kworker.0 00000004:00080000:0.0:1787862494.238000:0:14407:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 545272955542ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787862494.238086:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487680 00000100:00100000:2.0:1787862494.239235:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487552 00000100:00100000:2.0:1787862494.239252:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487552 00000100:00080000:1.0:1787862494.239310:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862494.239357:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862494.239385:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246487552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862494.239440:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862494.239560:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874709246487552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862494.239568:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787862494.241793:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a005bce580 x1874709246487552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862494.241829:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246487552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862494.242535:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487680 00000100:00100000:0.0:1787862494.242633:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862494.242645:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14408:x1874709246487680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787862494.245693:0:15067:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787862494.245710:0:15067:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787862494.245718:0:15067:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787862494.284927:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.284942:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.285587:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.285593:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.285610:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.286984:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.287005:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.287014:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.287071:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862494.291329:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.291344:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.291363:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.291367:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.291374:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.291389:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.291400:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.291421:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.291447:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787862494.291592:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862494.291601:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291610:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862494.291614:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291625:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291662:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291684:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b606ad14/0x391a6cd368cdae1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291707:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862494.291711:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291717:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8a400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862494.291721:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291728:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291752:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291760:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000268ea2c2/0x391a6cd368cdae21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.291772:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.291773:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.291775:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.292114:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.295300:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.295312:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.295330:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.295334:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.295341:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.295354:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.295364:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.295373:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.295399:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862494.304706:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.304729:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.304762:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.304768:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.304774:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.304790:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.304801:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.304808:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.304840:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787862494.305143:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862494.305161:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305177:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8ba00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.305185:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305200:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305237:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305246:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e76dcc1/0x391a6cd368cdae28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305291:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862494.305296:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305304:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8a600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.305318:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305329:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305342:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305351:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019e6d7d3/0x391a6cd368cdae2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.305366:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.305370:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.305377:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.308320:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.308337:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.308354:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.308359:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.308366:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.308382:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.308405:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.308413:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.308438:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862494.308473:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862494.308488:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.308501:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8ae00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.308508:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.308521:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.308544:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.308641:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000615d9300/0x391a6cd368cdae36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.308671:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.308673:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.308675:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.313155:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.313294:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.313311:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.313331:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.313336:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.313344:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.313360:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.313370:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.313378:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.313418:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862494.313441:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862494.313453:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.313468:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8bc00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.313474:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.313487:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.313516:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.313524:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027cc5dbe/0x391a6cd368cdae3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.313625:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.313627:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.313637:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.314941:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.314961:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.314977:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.314980:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.314986:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.314998:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315008:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315015:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315058:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862494.315159:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862494.315172:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.315185:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.315192:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.315205:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.315232:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.315241:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a9c0366/0x391a6cd368cdae44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.315278:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.315281:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.315283:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.315541:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.315548:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315558:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.315569:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.315574:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315584:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315593:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315601:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.315623:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862494.316031:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.316065:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.316075:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.316078:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.316083:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.316169:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862494.316179:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.316188:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.316192:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.316222:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.316241:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.316249:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e66d2f3a/0x391a6cd368cdae4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.316270:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.316272:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.316273:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.321230:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.321246:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.321272:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.321301:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862494.321689:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862494.321704:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.321718:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8ac00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862494.321724:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.321752:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.321779:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.321807:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd2a058/0x391a6cd368cdae52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862494.321840:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.321842:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.321844:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.322498:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.322508:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322726:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.322730:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.322737:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322751:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322761:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322769:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322791:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862494.322807:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.322814:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322833:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8a000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.322838:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322848:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322868:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322874:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003749070a/0x391a6cd368cdae59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.322896:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.322898:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.322899:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862494.324818:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.324830:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.324847:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.324852:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.324858:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.324872:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.324892:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.324900:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.325217:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862494.325791:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862494.325799:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.325810:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1787862494.325814:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862494.325818:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.325828:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.325836:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.325844:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327790:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862494.327804:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327829:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862494.327834:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327845:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327869:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327876:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099bcff2a/0x391a6cd368cdae60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327904:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862494.327909:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327916:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8a800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862494.327919:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327927:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.327936:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862494.328112:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787862494.330323:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.330336:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.330339:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.333070:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787862494.333098:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.333099:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008004ba9d/0x391a6cd368cdae67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862494.337131:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.337146:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.337294:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.337300:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.337307:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.337323:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.337334:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.337342:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.337405:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862494.338079:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.338086:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.338119:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.338122:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.338128:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.338140:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.338148:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.338161:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.340804:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862494.340820:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.340834:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.340839:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.340851:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.340876:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.340886:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011cd81e0/0x391a6cd368cdae6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.340971:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862494.340992:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.341019:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862494.341024:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.341034:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.341078:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.341099:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862494.341101:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862494.341104:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.348903:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862494.348919:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.349620:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862494.364734:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862494.364747:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.364766:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1787862494.364770:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862494.364778:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.364792:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.364817:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.364824:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.364855:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862494.365609:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.365619:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.365704:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.365708:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.365717:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.365738:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.365745:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094dab6d9/0x391a6cd368cdae7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.365768:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.365770:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.365772:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862494.366335:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862494.366343:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.366355:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1787862494.366359:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862494.366365:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.366376:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.366384:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.366392:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.366424:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862494.366708:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.366715:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.366722:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9c00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.366726:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.366735:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.366756:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.366763:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d834a1a/0x391a6cd368cdae83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.366779:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.366781:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.366783:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862494.368624:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862494.368646:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.368660:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1787862494.368664:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862494.368670:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.368682:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.368691:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.368698:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.384735:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862494.385804:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.385817:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.385830:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.385836:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.385848:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.385870:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.385879:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009de56ba7/0x391a6cd368cdae8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.385926:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.385929:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.385931:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862494.387079:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862494.387101:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.387117:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1787862494.387130:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862494.387138:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.387152:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.387163:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.387170:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.387199:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862494.388163:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.388172:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.388183:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.388189:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.388200:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.388219:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.388226:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c000ec2/0x391a6cd368cdae91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.388251:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.388254:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.388256:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862494.391126:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862494.391142:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.391161:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1787862494.391166:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862494.391172:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.391187:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.391197:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.391213:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.391247:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862494.392102:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.392113:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.392138:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9a00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.392143:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.392153:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.392173:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.392180:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b63849/0x391a6cd368cdae98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.392208:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.392210:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.392212:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862494.400297:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.400312:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.400331:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.400336:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.400343:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.400372:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.400384:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.400392:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.400422:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862494.406401:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.406413:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.406433:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.406437:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.406443:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.406457:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.406467:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.406497:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.408111:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787862494.408883:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.408891:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.408907:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.408912:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.408918:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.408931:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.408940:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.408947:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423654:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787862494.423671:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423685:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.423691:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423703:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423746:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423753:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e576a2/0x391a6cd368cdae9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423778:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862494.423781:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423787:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.423790:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423796:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423803:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423809:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068e5a3d1/0x391a6cd368cdaea6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423819:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.423823:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423836:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2de00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.423839:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423847:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423857:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.423866:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.423867:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.423869:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.425467:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862494.425494:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a8c81d/0x391a6cd368cdaead lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.425776:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862494.427177:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.427188:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.427203:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.427208:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.427215:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.427229:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.427240:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.427248:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.427314:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862494.430722:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.430735:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.430752:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.430756:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.430771:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.430786:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.430797:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.430805:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.430817:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787862494.431699:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862494.431710:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431720:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c200 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862494.431724:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431734:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431753:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431761:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9f94780/0x391a6cd368cdaeb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431779:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862494.431782:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431801:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d400 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862494.431804:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431811:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431820:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431826:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3919b1f/0x391a6cd368cdaebb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862494.431839:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862494.431840:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862494.431842:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862494.432626:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.435365:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.435385:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.435390:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.435396:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.435412:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.435423:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.435453:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.437910:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862494.438676:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.438685:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.438702:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.438707:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.438713:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.438726:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.438735:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.438742:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443351:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862494.443371:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443389:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2cc00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.443395:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443408:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443435:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443461:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db62bf15/0x391a6cd368cdaec2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443507:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862494.443511:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443518:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2ca00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862494.443521:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443529:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443540:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862494.443548:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.443549:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862494.443551:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.444110:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862494.444121:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020ebd6fd/0x391a6cd368cdaec9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862494.445128:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862494.445137:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.445153:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1787862494.445158:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862494.445165:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.445177:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.445186:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.445194:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.445204:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787862494.445388:0:15067:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787862494.445644:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874709246487680:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787862494.445675:0:14408:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787862494.445725:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874709246487808:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787862494.445763:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862494.445817:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112c09540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862494.445841:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487808 00000100:00100000:0.0:1787862494.445846:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487808 00000100:00100000:0.0:1787862494.445893:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862494.445903:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14408:x1874709246487808:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787862494.446225:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14408:x1874709246487680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 203581us (213512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862494.446235:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:0.0:1787862494.446302:0:15065:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1787862494.447158:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862494.447167:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.447191:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862494.447195:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.447206:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.447227:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.447234:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f0fdb6/0x391a6cd368cdaed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862494.447260:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.447262:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862494.447263:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862494.448728:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862494.473070:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14408:x1874709246487808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27158us (27296us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787862494.473084:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862494.473160:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874709246487808:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787862494.473176:0:14408:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1787862495.045776:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862495.757254:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862495.757280:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246487936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862495.757350:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862495.757697:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246487936 00000100:00100000:2.0:1787862495.757706:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246487936 00000100:00100000:2.0:1787862495.757775:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787862495.757786:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246487936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862495.757824:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862495.757874:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246487936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862495.757881:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862495.758093:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246487936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862496.079408:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862496.516683:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787862497.092413:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862497.198899:0:16144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787862498.119018:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862499.144380:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862499.332912:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862499.332940:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246488064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862499.333033:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862499.333116:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488064 00000100:00100000:3.0:1787862499.333123:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488064 00000100:00100000:3.0:1787862499.333180:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862499.333190:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246488064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862499.333225:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862499.333277:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3328:x1874709246488064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.333285:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862499.333345:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246488064:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787862499.333752:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862499.336998:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246488320:0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.337099:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862499.337137:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862499.337143:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246488448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.337173:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862499.338616:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246488576:0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.338672:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862499.338711:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862499.338717:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246488192:0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.338759:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862499.338788:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246488704:0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.338816:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862499.338849:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488448 00000100:00100000:0.0:1787862499.338857:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488448 00000100:00100000:0.0:1787862499.338905:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488576 00000100:00100000:0.0:1787862499.338909:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488576 00000100:00100000:0.0:1787862499.338933:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488704 00000100:00100000:0.0:1787862499.338936:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488704 00000100:00100000:0.0:1787862499.338954:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862499.338962:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246488448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.339019:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246488448:12345-0@lo:400:kworker.0 Request processed in 57us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.339027:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862499.339073:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862499.339080:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246488576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.339114:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246488576:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.339120:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862499.339131:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862499.339137:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246488704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862499.339163:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246488704:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.339169:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787862499.339227:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a005bcc3c0 x1874709246488448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862499.339254:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246488448:0@lo:400:kworker.0 00000100:00100000:1.0:1787862499.340531:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488320 00000100:00100000:1.0:1787862499.340541:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488320 00000100:00100000:1.0:1787862499.340588:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862499.340597:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246488320:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787862499.340638:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a005bcf0c0 x1874709246488704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862499.340650:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246488704:0@lo:400:kworker.0 00010000:00080000:0.0:1787862499.340662:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a005bcc000 x1874709246488576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862499.340670:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246488576:0@lo:400:kworker.0 00000100:00100000:1.0:1787862499.340677:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246488320:12345-0@lo:400:kworker.0 Request processed in 82us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862499.340684:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787862499.340701:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862499.340705:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862499.340723:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246488320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862499.343571:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488192 00000100:00100000:3.0:1787862499.343586:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488192 00000100:00100000:3.0:1787862499.343638:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787862499.343648:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246488192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862499.343755:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246488192:12345-0@lo:400:kworker.0 Request processed in 108us (4994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.343763:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787862499.344002:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246488192:0@lo:400:kworker.0 00000001:00080000:3.0:1787862499.470289:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787862499.470328:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787862499.642228:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862499.642348:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223417600 00000100:00100000:1.0:1787862499.642358:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223417600 00000100:00100000:0.0:1787862499.644205:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:0.0:1787862499.644217:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1874709223417600:12345-192.168.202.9@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787862499.644252:0:14376:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 11f775cd-efec-442d-9c84-9e6fe739a736@192.168.202.9@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1787862499.644290:0:14376:0:(genops.c:1385:class_connect()) connect: client 11f775cd-efec-442d-9c84-9e6fe739a736, cookie 0x391a6cd368cdaed7 00000100:00080000:0.0:1787862499.644520:0:14376:0:(import.c:65:import_set_state_nolock()) ffff89a0082ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862499.644596:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+5:2351:x1874709223417600:12345-192.168.202.9@tcp:250:mount.lustre.0 Request processed in 377us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.644604:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:2.0:1787862499.676339:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862499.677177:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223417728 00000100:00100000:3.0:1787862499.677191:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223417728 00000100:00100000:3.0:1787862499.677278:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:3.0:1787862499.677291:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+5:13841:x1874709223417728:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787862499.677314:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862499.677338:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2ca00/0x391a6cd368cdaede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0961 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862499.677375:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2ca00/0x391a6cd368cdaede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0961 expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862499.677389:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2ca00/0x391a6cd368cdaede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0961 expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862499.677401:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2ca00, rc 0) 00000100:00100000:3.0:1787862499.677509:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+6:13841:x1874709223417728:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 221us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.677518:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:1.0:1787862499.689186:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.694430:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223417856 00000100:00100000:0.0:1787862499.694446:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223417856 00000100:00100000:0.0:1787862499.694585:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:0.0:1787862499.694597:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+6:13841:x1874709223417856:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787862499.695102:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+6:13841:x1874709223417856:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 444us (5871us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787862499.695109:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:2.0:1787862499.698197:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.698307:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223417984 00000100:00100000:0.0:1787862499.698317:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223417984 00000100:00100000:0.0:1787862499.698474:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:0.0:1787862499.698486:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+6:13841:x1874709223417984:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787862499.698506:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862499.698526:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13ee8b800/0x391a6cd368cdaee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0968 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862499.698556:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13ee8b800/0x391a6cd368cdaee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0968 expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862499.698569:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13ee8b800/0x391a6cd368cdaee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0968 expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862499.698578:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8b800, rc 0) 00000100:00100000:0.0:1787862499.698657:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+7:13841:x1874709223417984:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 162us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.698665:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:2.0:1787862499.700519:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.700610:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418112 00000100:00100000:0.0:1787862499.700621:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418112 00000100:00100000:0.0:1787862499.700790:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:0.0:1787862499.700801:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+7:13841:x1874709223418112:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787862499.701253:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+8:13841:x1874709223418112:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 453us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.701261:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:1.0:1787862499.716989:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.717125:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418240 00000100:00100000:0.0:1787862499.717143:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418240 00000100:00100000:0.0:1787862499.717231:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:0.0:1787862499.717267:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+8:13841:x1874709223418240:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787862499.718034:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+8:13841:x1874709223418240:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 766us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.718122:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:2.0:1787862499.725880:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.726337:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418368 00000100:00100000:0.0:1787862499.726351:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418368 00000100:00100000:0.0:1787862499.726429:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:0.0:1787862499.726442:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+8:13859:x1874709223418368:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862499.727169:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+8:13859:x1874709223418368:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 725us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.727179:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:2.0:1787862499.757476:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.757668:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418496 00000100:00100000:0.0:1787862499.757682:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418496 00000100:00100000:0.0:1787862499.757771:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:0.0:1787862499.757783:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+8:13859:x1874709223418496:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862499.758241:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+8:13859:x1874709223418496:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 457us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.758250:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:1.0:1787862499.768024:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.768695:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418624 00000100:00100000:0.0:1787862499.768710:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418624 00000100:00100000:0.0:1787862499.768793:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:0.0:1787862499.768806:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+8:13841:x1874709223418624:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787862499.768842:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862499.768870:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13ee8b200/0x391a6cd368cdaeec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0992 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862499.768941:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13ee8b200/0x391a6cd368cdaeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0992 expref: 9 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862499.768953:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13ee8b200/0x391a6cd368cdaeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0992 expref: 9 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862499.768965:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8b200, rc 0) 00000100:00100000:0.0:1787862499.769153:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+9:13841:x1874709223418624:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 349us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.769162:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:2.0:1787862499.787541:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.787632:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418752 00000100:00100000:0.0:1787862499.787645:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418752 00000100:00100000:0.0:1787862499.787801:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:0.0:1787862499.787812:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+9:13841:x1874709223418752:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787862499.787855:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787862499.787887:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787862499.787892:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787862499.787896:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787862499.787899:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787862499.797785:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+9:13841:x1874709223418752:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 9958us (10243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.797806:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:2.0:1787862499.801382:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862499.801543:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223418880 00000100:00100000:3.0:1787862499.801555:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223418880 00000100:00100000:3.0:1787862499.801628:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:3.0:1787862499.801652:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+9:13841:x1874709223418880:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787862499.801686:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862499.801719:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0999 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862499.801762:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862499.801775:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862499.801786:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862499.802099:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+10:13841:x1874709223418880:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 460us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.802107:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:2.0:1787862499.806347:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.806951:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419008 00000100:00100000:0.0:1787862499.806966:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419008 00000100:00100000:0.0:1787862499.807135:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:0.0:1787862499.807148:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+10:13841:x1874709223419008:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787862499.807499:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+10:13841:x1874709223419008:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 352us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.807508:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:2.0:1787862499.814155:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862499.814273:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419136 00000100:00100000:3.0:1787862499.814284:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419136 00000100:00100000:3.0:1787862499.814344:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:3.0:1787862499.814355:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+10:13841:x1874709223419136:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787862499.814801:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+10:13841:x1874709223419136:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 446us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.814821:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:2.0:1787862499.819121:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.819413:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419264 00000100:00100000:0.0:1787862499.819430:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419264 00000100:00100000:0.0:1787862499.819495:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:0.0:1787862499.819516:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+10:13864:x1874709223419264:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862499.819831:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+10:13864:x1874709223419264:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 317us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.819840:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:2.0:1787862499.840008:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862499.840878:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419392 00000100:00100000:1.0:1787862499.840898:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419392 00000100:00100000:1.0:1787862499.840963:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:1.0:1787862499.840973:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+10:13864:x1874709223419392:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862499.847890:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+10:13864:x1874709223419392:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 6900us (7872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862499.847906:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:2.0:1787862499.868931:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862499.869008:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419520 00000100:00100000:0.0:1787862499.869018:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419520 00000100:00100000:0.0:1787862499.869127:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1787862499.869135:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874709223419520:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787862499.869167:0:14385:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from f06987a3-b399-4fd0-8db5-0cc18e603de6@192.168.202.9@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1787862499.869219:0:14385:0:(genops.c:1385:class_connect()) connect: client f06987a3-b399-4fd0-8db5-0cc18e603de6, cookie 0x391a6cd368cdaefa 00000004:00100000:0.0:1787862499.869251:0:14385:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787862499.869257:0:14385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787862499.905539:0:14385:0:(import.c:65:import_set_state_nolock()) ffff89a0082cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862499.905630:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2351:x1874709223419520:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 36492us (36706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862499.905644:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1787862499.913669:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862499.913741:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862499.913778:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419648 00000100:00100000:2.0:1787862499.913788:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419648 00000100:00100000:1.0:1787862499.913998:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419776 00000100:00100000:1.0:1787862499.914003:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419776 00000100:00100000:1.0:1787862499.914073:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1787862499.914085:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:0:x1874709223419648:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787862499.914126:0:15798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862499.914208:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:0:x1874709223419648:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 124us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862499.914215:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1787862499.914245:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862499.914251:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13841:x1874709223419776:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787862499.914262:0:15798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862499.914283:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13841:x1874709223419776:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 33us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862499.914290:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00080000:2.0:1787862499.914514:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862499.921267:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862499.921797:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223419904 00000100:00100000:1.0:1787862499.921807:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223419904 00000100:00100000:1.0:1787862499.922075:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:1.0:1787862499.922093:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13841:x1874709223419904:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787862499.922216:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13841:x1874709223419904:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 129us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862499.922226:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1787862499.944298:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862499.944335:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862499.944358:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862499.946002:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420032 00000100:00100000:3.0:1787862499.946016:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420032 00000100:00100000:3.0:1787862499.946121:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420160 00000100:00100000:3.0:1787862499.946124:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420160 00000100:00100000:3.0:1787862499.946154:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1787862499.946166:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1874709223420032:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787862499.946204:0:16023:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from f06987a3-b399-4fd0-8db5-0cc18e603de6@192.168.202.9@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1787862499.946242:0:16023:0:(genops.c:1385:class_connect()) connect: client f06987a3-b399-4fd0-8db5-0cc18e603de6, cookie 0x391a6cd368cdaf01 00002000:00100000:3.0:1787862499.946255:0:16023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f06987a3-b399-4fd0-8db5-0cc18e603de6/ffff89a13c1ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862499.946280:0:16023:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787862499.946649:0:16023:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787862499.946682:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420288 00000100:00100000:1.0:1787862499.946688:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420288 00000100:00080000:3.0:1787862499.946700:0:16023:0:(import.c:65:import_set_state_nolock()) ffff89a13c1a8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862499.946725:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1787862499.946732:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13841:x1874709223420288:12345-192.168.202.9@tcp:33:mount.lustre.0 00000100:00100000:3.0:1787862499.946777:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2351:x1874709223420032:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 613us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.946785:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1787862499.946801:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862499.946805:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1874709223420160:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787862499.946821:0:16023:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from f06987a3-b399-4fd0-8db5-0cc18e603de6@192.168.202.9@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1787862499.946837:0:16023:0:(genops.c:1385:class_connect()) connect: client f06987a3-b399-4fd0-8db5-0cc18e603de6, cookie 0x391a6cd368cdaf08 00002000:00100000:3.0:1787862499.946845:0:16023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f06987a3-b399-4fd0-8db5-0cc18e603de6/ffff89a13c1ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862499.946852:0:16023:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787862499.947096:0:16023:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787862499.947113:0:16023:0:(import.c:65:import_set_state_nolock()) ffff89a13c1af000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862499.947145:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2351:x1874709223420160:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 337us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.947152:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000004:00080000:3.0:1787862499.949725:0:14386:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2924us 00000004:00200000:3.0:1787862499.964857:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787862499.965077:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13841:x1874709223420288:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 18339us (20711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862499.965092:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1787862500.149717:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862500.149916:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420416 00000100:00100000:3.0:1787862500.149926:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420416 00000100:00100000:3.0:1787862500.149994:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862500.150005:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13885:x1874709223420416:12345-192.168.202.9@tcp:101:mkdir.0 00010000:00010000:3.0:1787862500.150025:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862500.150125:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c09c3 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862500.150212:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cdaf16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862500.150227:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cdaf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862500.150242:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cdaf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862500.150493:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862500.150498:0:14384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862500.150602:0:14384:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cdaf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862500.150643:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09c3 expref: 8 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862500.150661:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cdaf16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09c3 expref: 7 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862500.150670:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:3.0:1787862500.150689:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862500.150693:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2da00, rc 0) 00000100:00100000:3.0:1787862500.150759:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:13885:x1874709223420416:12345-192.168.202.9@tcp:101:mkdir.0 Request processed in 756us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862500.150766:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00010000:00010000:1.0:1787862500.164492:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862500.868527:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862500.868559:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246488832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862500.868670:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862500.868804:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488832 00000100:00100000:1.0:1787862500.868814:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488832 00000100:00100000:1.0:1787862500.868886:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862500.868897:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246488832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862500.868921:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862500.868979:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246488832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862500.868988:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862500.869103:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246488832:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787862500.956546:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f06987a3-b399-4fd0-8db5-0cc18e603de6 00010000:00010000:1.0:1787862501.188315:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862502.218539:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862502.245264:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.245363:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420544 00000100:00100000:2.0:1787862502.245373:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420544 00000100:00100000:2.0:1787862502.245453:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1787862502.245464:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:13937:x1874709223420544:12345-192.168.202.9@tcp:41:lfs.0 00000004:00000024:2.0:1787862502.245524:0:14385:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787862502.245624:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:13937:x1874709223420544:12345-192.168.202.9@tcp:41:lfs.0 Request processed in 161us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.245632:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00080000:1.0:1787862502.245813:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862502.250439:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862502.250636:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420672 00000100:00100000:1.0:1787862502.250659:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420672 00000100:00100000:1.0:1787862502.250745:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:1.0:1787862502.250757:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:13937:x1874709223420672:12345-192.168.202.9@tcp:13:lfs.0 00002000:00000024:1.0:1787862502.250801:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862502.250894:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:13937:x1874709223420672:12345-192.168.202.9@tcp:13:lfs.0 Request processed in 139us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.250901:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00080000:2.0:1787862502.251066:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862502.254095:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862502.254236:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420800 00000100:00100000:1.0:1787862502.254248:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420800 00000100:00100000:1.0:1787862502.254338:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:1.0:1787862502.254351:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13937:x1874709223420800:12345-192.168.202.9@tcp:13:lfs.0 00000100:00080000:2.0:1787862502.254579:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787862502.254614:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862502.254744:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:13937:x1874709223420800:12345-192.168.202.9@tcp:13:lfs.0 Request processed in 394us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.254752:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862502.460557:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862502.461830:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223420928 00000100:00100000:0.0:1787862502.461848:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223420928 00000100:00100000:0.0:1787862502.461973:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:0.0:1787862502.461983:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+10:13968:x1874709223420928:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787862502.462002:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862502.462035:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13ee8a600/0x391a6cd368cdaf1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c09ca expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862502.462096:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13ee8a600/0x391a6cd368cdaf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09ca expref: 11 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862502.462114:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13ee8a600/0x391a6cd368cdaf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09ca expref: 11 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862502.462124:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8a600, rc 0) 00000100:00100000:0.0:1787862502.462200:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+11:13968:x1874709223420928:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 218us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.462207:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:0.0:1787862502.477605:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862502.490145:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421056 00000100:00100000:1.0:1787862502.490170:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421056 00000100:00100000:1.0:1787862502.491127:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:1.0:1787862502.491146:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+11:13968:x1874709223421056:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787862502.491609:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+11:13968:x1874709223421056:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 468us (14020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.491631:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1787862502.497548:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862502.524023:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421184 00000100:00100000:0.0:1787862502.524061:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421184 00000100:00100000:0.0:1787862502.524164:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:0.0:1787862502.524177:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+11:13968:x1874709223421184:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787862502.524556:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+11:13968:x1874709223421184:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 379us (27022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.524566:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:3.0:1787862502.552693:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862502.552842:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421312 00000100:00100000:0.0:1787862502.552855:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421312 00000100:00100000:0.0:1787862502.552938:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:0.0:1787862502.552950:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+11:13976:x1874709223421312:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862502.553440:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+11:13976:x1874709223421312:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 489us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.553450:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:3.0:1787862502.601529:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.602179:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421440 00000100:00100000:2.0:1787862502.602195:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421440 00000100:00100000:2.0:1787862502.602283:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:2.0:1787862502.602297:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+11:13976:x1874709223421440:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862502.602725:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+11:13976:x1874709223421440:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 429us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.602737:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:3.0:1787862502.622371:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862502.622504:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421568 00000100:00100000:1.0:1787862502.622520:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421568 00000100:00100000:1.0:1787862502.622610:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:1.0:1787862502.622625:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b24c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+11:13968:x1874709223421568:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787862502.622653:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862502.622690:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cdaf24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c09f4 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862502.622736:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cdaf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09f4 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862502.622751:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a1206a9c00/0x391a6cd368cdaf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09f4 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862502.622762:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a1206a9c00, rc 0) 00000100:00100000:1.0:1787862502.622868:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b24c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+12:13968:x1874709223421568:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 246us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.622877:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:3.0:1787862502.628639:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862502.628804:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421696 00000100:00100000:0.0:1787862502.628820:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421696 00000100:00100000:0.0:1787862502.628900:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:0.0:1787862502.628912:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13b24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+12:13968:x1874709223421696:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787862502.628957:0:14377:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787862502.628993:0:14377:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787862502.628999:0:14377:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787862502.629003:0:14377:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787862502.629005:0:14377:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787862502.645259:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13b24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+12:13968:x1874709223421696:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 16327us (16616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.645284:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:3.0:1787862502.661792:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.662278:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421824 00000100:00100000:2.0:1787862502.662293:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421824 00000100:00100000:2.0:1787862502.662379:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:2.0:1787862502.662391:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+12:13968:x1874709223421824:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862502.662427:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862502.662453:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c09fb expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862502.662493:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 13 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862502.662507:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 13 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862502.662519:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e400, rc 0) 00000100:00100000:2.0:1787862502.662612:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+13:13968:x1874709223421824:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 222us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.662621:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:3.0:1787862502.666581:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862502.668620:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223421952 00000100:00100000:0.0:1787862502.668641:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223421952 00000100:00100000:0.0:1787862502.668753:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:0.0:1787862502.668766:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:13968:x1874709223421952:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787862502.669627:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:13968:x1874709223421952:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 856us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.669639:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:3.0:1787862502.683191:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862502.683963:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422080 00000100:00100000:1.0:1787862502.683983:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422080 00000100:00100000:1.0:1787862502.684126:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:1.0:1787862502.684141:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+13:13968:x1874709223422080:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787862502.684515:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+13:13968:x1874709223422080:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 377us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.684525:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:3.0:1787862502.687271:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862502.687561:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422208 00000100:00100000:0.0:1787862502.687574:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422208 00000100:00100000:0.0:1787862502.687649:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:0.0:1787862502.687673:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:13982:x1874709223422208:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862502.688019:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:13982:x1874709223422208:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 349us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.688029:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:3.0:1787862502.690374:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.690513:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422336 00000100:00100000:2.0:1787862502.690526:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422336 00000100:00100000:2.0:1787862502.690598:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1787862502.690611:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+13:13982:x1874709223422336:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862502.690959:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+13:13982:x1874709223422336:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 348us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.690976:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:3.0:1787862502.703028:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862502.703148:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862502.703259:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.703666:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422848 00000100:00100000:2.0:1787862502.703680:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422848 00000100:00100000:2.0:1787862502.703762:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1787862502.703773:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:2355:x1874709223422848:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862502.703881:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:2355:x1874709223422848:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 108us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.703890:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862502.705103:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423104 00000100:00100000:0.0:1787862502.705103:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422976 00000100:00100000:1.0:1787862502.705118:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423104 00000100:00100000:0.0:1787862502.705118:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422976 00000100:00100000:0.0:1787862502.705193:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1787862502.705205:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223422976:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862502.705286:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223422976:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 83us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.705294:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1787862502.706333:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.706453:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422464 00000100:00100000:2.0:1787862502.706463:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422464 00000100:00100000:2.0:1787862502.706520:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1787862502.706529:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874709223422464:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787862502.706568:0:14385:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 24424550-2972-414f-9f3f-de7961d3d9cb@192.168.202.9@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1787862502.706621:0:14385:0:(genops.c:1385:class_connect()) connect: client 24424550-2972-414f-9f3f-de7961d3d9cb, cookie 0x391a6cd368cdaf32 00000004:00100000:2.0:1787862502.706678:0:14385:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787862502.706847:0:14385:0:(import.c:65:import_set_state_nolock()) ffff89a006010000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862502.706913:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+6:2351:x1874709223422464:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 384us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.706922:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1787862502.711320:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.711619:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422720 00000100:00100000:2.0:1787862502.711631:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422720 00000100:00100000:2.0:1787862502.711741:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1787862502.711753:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:13968:x1874709223422720:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787862502.711800:0:14384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787862502.711894:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:13968:x1874709223422720:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 143us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.711922:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00080000:3.0:1787862502.713571:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862502.716899:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1787862502.716929:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2355:x1874709223423104:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862502.717057:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2355:x1874709223423104:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 129us (13781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.717066:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1787862502.720448:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862502.720898:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223422592 00000100:00100000:1.0:1787862502.720914:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223422592 00000100:00100000:1.0:1787862502.721000:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:1.0:1787862502.721024:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+6:0:x1874709223422592:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787862502.721095:0:14385:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862502.726872:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+6:0:x1874709223422592:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 5839us (6421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.726894:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1787862502.727342:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.727631:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423232 00000100:00100000:2.0:1787862502.727643:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423232 00000100:00100000:2.0:1787862502.727725:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1787862502.727736:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:13968:x1874709223423232:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787862502.727844:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:13968:x1874709223423232:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 109us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862502.727852:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1787862502.735927:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.735985:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862502.736114:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862502.736210:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423360 00000100:00100000:3.0:1787862502.736223:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423360 00000100:00100000:3.0:1787862502.736278:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423488 00000100:00100000:3.0:1787862502.736281:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423488 00000100:00100000:3.0:1787862502.736304:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1787862502.736315:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874709223423360:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787862502.736367:0:15068:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 24424550-2972-414f-9f3f-de7961d3d9cb@192.168.202.9@tcp t0 exp 0000000000000000 cur 553 last 0 00000100:00100000:1.0:1787862502.736413:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423616 00000100:00100000:1.0:1787862502.736418:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423616 00000020:00000080:3.0:1787862502.736424:0:15068:0:(genops.c:1385:class_connect()) connect: client 24424550-2972-414f-9f3f-de7961d3d9cb, cookie 0x391a6cd368cdaf39 00002000:00100000:3.0:1787862502.736439:0:15068:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24424550-2972-414f-9f3f-de7961d3d9cb/ffff89a13c1ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862502.736453:0:15068:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787862502.736459:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1787862502.736466:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:13968:x1874709223423616:12345-192.168.202.9@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787862502.736672:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:3.0:1787862502.736804:0:15068:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787862502.736842:0:15068:0:(import.c:65:import_set_state_nolock()) ffff89a13c1ab800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862502.736929:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1787862502.736935:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874709223423488:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787862502.736955:0:15067:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 24424550-2972-414f-9f3f-de7961d3d9cb@192.168.202.9@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1787862502.736977:0:15067:0:(genops.c:1385:class_connect()) connect: client 24424550-2972-414f-9f3f-de7961d3d9cb, cookie 0x391a6cd368cdaf40 00002000:00100000:0.0:1787862502.736982:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 24424550-2972-414f-9f3f-de7961d3d9cb/ffff89a0082cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113978 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787862502.736990:0:15067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787862502.737123:0:15067:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787862502.737139:0:15067:0:(import.c:65:import_set_state_nolock()) ffff89a0082cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862502.737245:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:13968:x1874709223423616:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 777us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.737254:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:3.0:1787862502.737272:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24424550-2972-414f-9f3f-de7961d3d9cb+6:2351:x1874709223423360:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 958us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862502.737280:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1787862502.745450:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:2351:x1874709223423488:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 7719us (8541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862502.745473:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1787862503.020481:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862503.020634:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423744 00000100:00100000:3.0:1787862503.020647:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423744 00000100:00100000:3.0:1787862503.020740:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1787862503.020771:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24424550-2972-414f-9f3f-de7961d3d9cb+6:14003:x1874709223423744:12345-192.168.202.9@tcp:101:mkdir.0 00010000:00010000:3.0:1787862503.020801:0:15798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862503.020829:0:15798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cdaf47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a25 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862503.020923:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862503.020942:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862503.020965:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862503.021283:0:15798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862503.021288:0:15798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862503.021376:0:15798:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862503.022799:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c400/0x391a6cd368cdaf47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 8 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862503.022835:0:15798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 7 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862503.022846:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:3.0:1787862503.022850:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862503.022855:0:15798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2de00, rc 0) 00000100:00100000:3.0:1787862503.023840:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24424550-2972-414f-9f3f-de7961d3d9cb+7:14003:x1874709223423744:12345-192.168.202.9@tcp:101:mkdir.0 Request processed in 3059us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862503.023879:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00010000:00010000:1.0:1787862503.243504:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862504.262793:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862504.453155:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246488960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862504.453257:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862504.453366:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246488960 00000100:00100000:3.0:1787862504.453377:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246488960 00000100:00080000:3.0:1787862504.453452:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862504.453470:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862504.453481:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246488960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862504.453525:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862504.453586:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246488960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862504.453594:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862504.453652:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787862504.455840:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246488960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862504.455910:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246489344:0@lo:400:kworker.0 00000100:00100000:2.0:1787862504.455927:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246489216:0@lo:400:kworker.0 00000100:00100000:1.0:1787862504.456016:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246489088:0@lo:400:kworker.0 00000100:00100000:2.0:1787862504.467004:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862504.469949:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862504.473244:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489216 00000100:00100000:3.0:1787862504.473266:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489216 00000100:00100000:3.0:1787862504.473380:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862504.473395:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246489216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862504.479261:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246489216:12345-0@lo:400:kworker.0 Request processed in 5851us (12264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862504.479281:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787862504.479361:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862504.479394:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246489472:0@lo:400:kworker.0 00000100:00100000:3.0:1787862504.479497:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862504.479819:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489344 00000100:00100000:0.0:1787862504.479831:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489344 00000100:00100000:0.0:1787862504.479900:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489472 00000100:00100000:0.0:1787862504.479904:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489472 00000100:00100000:0.0:1787862504.479947:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862504.479957:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246489344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862504.481300:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874709246489344:12345-0@lo:400:kworker.0 Request processed in 1334us (11351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862504.481315:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862504.481355:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862504.481371:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246489472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862504.481458:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874709246489472:12345-0@lo:400:kworker.0 Request processed in 94us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862504.481466:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787862504.482771:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862504.482859:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3330:1874709246489472:0@lo:400:kworker.0 00000100:00100000:3.0:1787862504.482923:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874709246489344:0@lo:400:kworker.0 00000100:00100000:2.0:1787862504.483345:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246489216:0@lo:400:kworker.0 00000100:00100000:1.0:1787862504.484078:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862504.484136:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489088 00000100:00100000:1.0:1787862504.484145:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489088 00000100:00100000:1.0:1787862504.484214:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787862504.484225:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246489088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862504.484292:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246489088:12345-0@lo:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862504.484301:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787862504.484369:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246489088:0@lo:400:kworker.0 00000100:00100000:1.0:1787862504.484461:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246489600:0@lo:400:kworker.0 00000100:00100000:1.0:1787862504.484575:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862504.484604:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489600 00000100:00100000:1.0:1787862504.484608:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489600 00000100:00100000:1.0:1787862504.484780:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862504.484787:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246489600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862504.484825:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874709246489600:12345-0@lo:400:kworker.0 Request processed in 38us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862504.484832:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787862504.485104:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862504.485132:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3327:1874709246489600:0@lo:400:kworker.0 00000001:00100000:3.0:1787862504.549158:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24424550-2972-414f-9f3f-de7961d3d9cb 00000001:00100000:3.0:1787862504.549178:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f06987a3-b399-4fd0-8db5-0cc18e603de6 00000001:00100000:2.0:1787862505.099213:0:5890:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f06987a3-b399-4fd0-8db5-0cc18e603de6 00000001:00100000:2.0:1787862505.099239:0:5890:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24424550-2972-414f-9f3f-de7961d3d9cb 00010000:00010000:1.0:1787862505.284260:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862505.993801:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862505.993838:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246489728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862505.993961:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862505.994091:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489728 00000100:00100000:3.0:1787862505.994102:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489728 00000100:00100000:3.0:1787862505.994163:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787862505.994173:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246489728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862505.994217:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862505.994273:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246489728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862505.994283:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787862505.994347:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246489728:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787862506.078968:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24424550-2972-414f-9f3f-de7961d3d9cb 00010000:00010000:1.0:1787862506.310788:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862506.741485:0:16348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1787862506.757440:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787862507.332457:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862507.871911:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.871980:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.872023:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.872080:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.872104:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.872128:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.872157:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862507.872202:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424384 00000100:00100000:2.0:1787862507.872214:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424384 00000100:00100000:2.0:1787862507.872307:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424000 00000100:00100000:2.0:1787862507.872311:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424000 00000100:00100000:2.0:1787862507.872338:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1787862507.872348:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:2353:x1874709223424384:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862507.872637:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:2353:x1874709223424384:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 288us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862507.872647:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1787862507.872674:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:2.0:1787862507.872683:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2353:x1874709223424000:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862507.872716:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2353:x1874709223424000:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862507.872722:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1787862507.873293:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424128 00000100:00100000:1.0:1787862507.873300:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424128 00000100:00100000:1.0:1787862507.873349:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424640 00000100:00100000:1.0:1787862507.873353:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424640 00000100:00100000:1.0:1787862507.873374:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424256 00000100:00100000:1.0:1787862507.873377:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424256 00000100:00100000:1.0:1787862507.873388:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424512 00000100:00100000:1.0:1787862507.873390:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424512 00000100:00100000:1.0:1787862507.873407:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:1.0:1787862507.873415:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2353:x1874709223424128:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862507.873485:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2353:x1874709223424128:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 70us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862507.873492:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:1.0:1787862507.873508:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:1.0:1787862507.873515:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2353:x1874709223424640:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862507.873542:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2353:x1874709223424640:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 28us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862507.873548:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:1.0:1787862507.873559:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862507.873565:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2353:x1874709223424256:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862507.873587:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2353:x1874709223424256:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 22us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862507.873593:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862507.873605:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1787862507.873620:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2353:x1874709223424512:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862507.873644:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2353:x1874709223424512:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 34us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862507.873661:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00080000:1.0:1787862507.873684:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862507.873689:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862507.873692:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862507.875523:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223423872 00000100:00100000:0.0:1787862507.875544:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223423872 00000100:00100000:0.0:1787862507.875629:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00100000:0.0:1787862507.875643:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:2353:x1874709223423872:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862507.875751:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:2353:x1874709223423872:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 110us (3856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862507.875760:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 105 00010000:00010000:1.0:1787862508.359328:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862509.381413:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862509.572367:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246490240:0@lo:400:kworker.0 00000100:00100000:2.0:1787862509.572441:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862509.572494:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862509.572501:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246490112:0@lo:400:kworker.0 00000100:00100000:2.0:1787862509.572526:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862509.572561:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246490240 00000100:00100000:2.0:1787862509.572567:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246490240 00000100:00100000:2.0:1787862509.572610:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862509.572620:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246490240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.572738:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079ae7a9-a8cb-4160-870b-e99ad994d115:3329:1874709246489856:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.572774:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862509.572799:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108677840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246490368:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.572821:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862509.572839:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787862509.572845:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246489984:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.572877:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862509.572894:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246490496:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.572913:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862509.572939:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489856 00000100:00100000:0.0:1787862509.572943:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489856 00000100:00100000:0.0:1787862509.572981:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787862509.572987:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3329:x1874709246489856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573025:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3329:x1874709246489856:12345-0@lo:400:kworker.0 Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862509.573033:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787862509.573085:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246490368 00000100:00100000:0.0:1787862509.573089:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246490368 00000100:00100000:0.0:1787862509.573115:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246490496 00000100:00100000:0.0:1787862509.573118:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246490496 00000100:00100000:0.0:1787862509.573132:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862509.573138:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246490368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573169:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874709246490368:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862509.573175:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787862509.573186:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787862509.573192:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246490496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573217:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874709246490496:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862509.573223:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787862509.573239:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246490112 00000100:00100000:0.0:1787862509.573243:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246490112 00000100:00100000:0.0:1787862509.573267:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246489984 00000100:00100000:0.0:1787862509.573276:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246489984 00000100:00100000:0.0:1787862509.573299:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862509.573306:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246490112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573343:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246490112:12345-0@lo:400:kworker.0 Request processed in 37us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862509.573364:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862509.573376:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862509.573382:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246489984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573407:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246489984:12345-0@lo:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862509.573413:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787862509.573431:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862509.573434:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862509.573437:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862509.573463:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246489984:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573472:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3329:1874709246490496:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573480:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d0bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079ae7a9-a8cb-4160-870b-e99ad994d115:3329:1874709246489856:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573486:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108677840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3329:1874709246490368:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.573526:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246490112:0@lo:400:kworker.0 00000100:00100000:2.0:1787862509.573622:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246490240:12345-0@lo:400:kworker.0 Request processed in 1003us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862509.573630:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787862509.573999:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246490240:0@lo:400:kworker.0 00000100:00100000:0.0:1787862509.576426:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862509.576446:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246490624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862509.576516:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862509.576854:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246490624 00000100:00100000:3.0:1787862509.576863:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246490624 00000100:00100000:3.0:1787862509.576920:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787862509.576930:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246490624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862509.576977:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862509.577026:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246490624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862509.577072:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787862509.577118:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246490624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862510.422340:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862511.110429:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246490752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862511.110545:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862511.112550:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246490752 00000100:00100000:0.0:1787862511.112595:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246490752 00000100:00100000:0.0:1787862511.112690:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862511.112702:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246490752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862511.112756:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862511.112877:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246490752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862511.112887:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787862511.113088:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862511.119542:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246490752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862511.429348:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787862511.776672:0:16499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc21444df0 20000000:00000080:1.0:1787862511.776691:0:16499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89a005531c00 uarg=0000000000000000 20000000:01000000:1.0:1787862511.776733:0:16499:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787862511.776740:0:16499:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787862511.776745:0:16499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787862511.777703:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787862511.777805:0:16499:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787862511.783418:0:16499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787862511.783456:0:16499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.783476:0:16499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 18 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.783485:0:16499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.783494:0:16499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.783505:0:16499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.783532:0:16499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.783540:0:16499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.783697:0:16499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.783744:0:16499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 12 pid: 14378 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.783768:0:16499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246490880:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862511.783949:0:16499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.783960:0:16499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.783974:0:16499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491008:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862511.784011:0:16499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.784021:0:16499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 18 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.784031:0:16499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108677c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491136:0@lo:104: 00000100:00100000:2.0:1787862511.784114:0:16499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862511.784977:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491136 00000100:00100000:1.0:1787862511.784991:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491136 00000100:00100000:1.0:1787862511.785080:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862511.785094:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079ae7a9-a8cb-4160-870b-e99ad994d115+3:16499:x1874709246491136:12345-0@lo:104: 00010000:00010000:1.0:1787862511.785227:0:14367:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.785342:0:16499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.785349:0:14367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862511.785357:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079ae7a9-a8cb-4160-870b-e99ad994d115+3:16499:x1874709246491136:12345-0@lo:104: Request processed in 268us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862511.785366:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787862511.785375:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862511.785386:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.785396:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a8000 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862511.785402:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.785413:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862511.785422:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862511.785429:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787862511.785476:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.785483:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862511.785509:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.785532:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1206a8000/0x391a6cd368cdadcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdadd4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.785551:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862511.785553:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862511.785555:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862511.785574:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079ae7a9-a8cb-4160-870b-e99ad994d115:3329:1874709246491392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862511.785634:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862511.785704:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491392 00000100:00100000:0.0:1787862511.785711:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491392 00010000:00010000:0.0:1787862511.785741:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 19 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862511.785774:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862511.785783:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3329:x1874709246491392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862511.785797:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862511.785804:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 19 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.785842:0:16499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 19 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.785853:0:16499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491264:0@lo:104: 00000100:00100000:2.0:1787862511.785885:0:16499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862511.788310:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 19 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.788352:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862511.788462:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3329:x1874709246491392:12345-0@lo:103:ldlm_bl.0 Request processed in 2677us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862511.788474:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862511.788530:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491264 00000100:00100000:0.0:1787862511.788561:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491264 00000100:00100000:0.0:1787862511.788623:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862511.788633:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:16499:x1874709246491264:12345-0@lo:104: 00010000:00010000:0.0:1787862511.788654:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.788712:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862511.788718:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:16499:x1874709246491264:12345-0@lo:104: Request processed in 88us (2832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862511.788725:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787862511.788743:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862511.788750:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.788758:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a100031a00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862511.788763:0:14372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.788773:0:14372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862511.788781:0:14372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862511.788789:0:14372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787862511.788843:0:14372:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862511.788854:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079ae7a9-a8cb-4160-870b-e99ad994d115:3329:1874709246491392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862511.788855:0:14372:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862511.788884:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.788901:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a100031a00/0x391a6cd368cdac92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac99 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.788922:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862511.788934:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246491520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862511.788937:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862511.788941:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862511.789011:0:16499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 18 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862511.789013:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787862511.789033:0:16499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 18 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.789081:0:16499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491648:0@lo:104: 00000100:00100000:2.0:1787862511.789131:0:16499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862511.789154:0:16499:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a11026a480 going to sleep for 11 seconds 00010000:00010000:2.0:1787862511.789177:0:16499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1420e9400/0x391a6cd368cdadd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdadcd expref: 18 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.789190:0:16499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108677c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491136:0@lo:104: 00000100:00100000:2.0:1787862511.789199:0:16499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108675e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491264:0@lo:104: 00000100:00100000:0.0:1787862511.790808:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491520 00000100:00100000:0.0:1787862511.790823:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491520 00010000:00010000:0.0:1787862511.790876:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 18 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862511.790917:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862511.790940:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:079ae7a9-a8cb-4160-870b-e99ad994d115+18:3330:x1874709246491520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862511.790957:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862511.790963:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 18 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.790985:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 18 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791009:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1420e8e00/0x391a6cd368cdac99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdac92 expref: 18 pid: 14376 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791027:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862511.791142:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:079ae7a9-a8cb-4160-870b-e99ad994d115+17:3330:x1874709246491520:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862511.791151:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862511.791193:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787862511.791237:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491648 00000100:00100000:0.0:1787862511.791241:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491648 00000100:00100000:0.0:1787862511.791275:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862511.791282:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1363c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:16499:x1874709246491648:12345-0@lo:104: 00010000:00010000:0.0:1787862511.791296:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791341:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862511.791347:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1363c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+3:16499:x1874709246491648:12345-0@lo:104: Request processed in 67us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862511.791353:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787862511.791406:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862511.791413:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791421:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1420e8c00 already unused, calling callback (ffffffffc1c25c20) 10000000:00010000:0.0:1787862511.791426:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791436:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862511.791444:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862511.791450:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787862511.791490:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791498:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862511.791542:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791550:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff89a1420e8c00/0x391a6cd368cdac45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x391a6cd368cdac4c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791568:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862511.791570:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862511.791572:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862511.791591:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862511.791607:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079ae7a9-a8cb-4160-870b-e99ad994d115:3328:1874709246491776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862511.791651:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862511.791697:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491776 00000100:00100000:0.0:1787862511.791702:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491776 00010000:00010000:0.0:1787862511.791723:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 17 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862511.791744:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862511.791750:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a0056e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:3328:x1874709246491776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862511.791758:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862511.791762:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 17 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791771:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 17 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862511.791783:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862511.791811:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a0056e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:3328:x1874709246491776:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862511.791818:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862511.791889:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079ae7a9-a8cb-4160-870b-e99ad994d115:3328:1874709246491776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862511.792741:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246491520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862511.792801:0:16499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a100031e00/0x391a6cd368cdac4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x391a6cd368cdac45 expref: 16 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.792823:0:16499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491648:0@lo:104: 00000100:00100000:1.0:1787862511.795501:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862511.795575:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424768 00000100:00100000:3.0:1787862511.795584:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424768 00010000:00010000:3.0:1787862511.795631:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 13 pid: 14378 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862511.795673:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1787862511.795682:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f775cd-efec-442d-9c84-9e6fe739a736+13:2352:x1874709223424768:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862511.795698:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862511.795704:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 13 pid: 14378 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862511.795718:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 13 pid: 14378 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862511.795739:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862511.795801:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f775cd-efec-442d-9c84-9e6fe739a736+13:2352:x1874709223424768:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862511.795809:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00010000:00010000:2.0:1787862511.796583:0:16499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09fb expref: 12 pid: 14378 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862511.796607:0:16499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246490880:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862511.805684:0:16499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16499:1874709246491008:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862511.805743:0:16499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862511.808097:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862511.812852:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223424896 00000100:00100000:0.0:1787862511.812873:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223424896 00010000:00010000:1.0:1787862511.813088:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862511.813144:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:1.0:1787862511.813156:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f775cd-efec-442d-9c84-9e6fe739a736+12:2353:x1874709223424896:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862511.813175:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862511.813200:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813215:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813240:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a104c2c600/0x391a6cd368cdaef3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0999 expref: 12 pid: 14377 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813264:0:14370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813274:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813295:0:14370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813303:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813312:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813320:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813326:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862511.813331:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.813340:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.818902:0:16499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862511.818959:0:16499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.819844:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.819864:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a1206a9e00/0x391a6cd368cdaf55 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862511.819900:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862511.820030:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f775cd-efec-442d-9c84-9e6fe739a736+11:2353:x1874709223424896:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 6867us (11936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862511.820061:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00010000:00010000:1.0:1787862512.458453:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862512.995523:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995592:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995628:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995662:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995682:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995701:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995727:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862512.995762:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425408 00000100:00100000:1.0:1787862512.995771:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425408 00000100:00100000:1.0:1787862512.995822:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425664 00000100:00100000:1.0:1787862512.995825:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425664 00000100:00100000:1.0:1787862512.995836:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425280 00000100:00100000:1.0:1787862512.995838:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425280 00000100:00100000:1.0:1787862512.995848:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425792 00000100:00100000:1.0:1787862512.995850:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425792 00000100:00100000:1.0:1787862512.995864:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1787862512.995873:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2354:x1874709223425408:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.995979:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2354:x1874709223425408:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.995987:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1787862512.996005:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862512.996011:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2354:x1874709223425664:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.996033:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2354:x1874709223425664:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.996073:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862512.996084:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1787862512.996090:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2354:x1874709223425280:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.996112:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2354:x1874709223425280:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 22us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.996117:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1787862512.996128:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862512.996134:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2354:x1874709223425792:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.996154:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2354:x1874709223425792:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.996160:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862512.996177:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425024 00000100:00100000:1.0:1787862512.996181:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425024 00000100:00100000:1.0:1787862512.996205:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:1.0:1787862512.996211:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+11:2354:x1874709223425024:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.996235:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+11:2354:x1874709223425024:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.996248:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:1.0:1787862512.996282:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425152 00000100:00100000:1.0:1787862512.996286:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425152 00000100:00100000:1.0:1787862512.996324:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425536 00000100:00100000:1.0:1787862512.996327:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425536 00000100:00100000:1.0:1787862512.996347:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1787862512.996354:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2354:x1874709223425152:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.996382:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2354:x1874709223425152:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.996389:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1787862512.996399:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:1.0:1787862512.996405:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:2354:x1874709223425536:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1787862512.996429:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:2354:x1874709223425536:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.996434:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00080000:1.0:1787862512.996452:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862512.996456:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862512.996458:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1787862513.352523:0:14380:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862513.352546:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a13ee4c800 from 10 10000000:01000000:0.0:1787862513.352552:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862513.352601:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862513.352614:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862513.352626:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862513.352651:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb79e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246491904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862513.352728:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862513.352786:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a111397cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862513.354374:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246491904 00000100:00100000:2.0:1787862513.354386:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246491904 00000100:00100000:2.0:1787862513.354443:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862513.354454:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13f007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+16:14380:x1874709246491904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862513.354471:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862513.354489:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79f600/0x391a6cd368cdaf63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdaf5c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.354515:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79f600/0x391a6cd368cdaf63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdaf5c expref: 17 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.354526:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79f600/0x391a6cd368cdaf63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdaf5c expref: 17 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.354534:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f600, rc 0) 00000100:00100000:2.0:1787862513.354603:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13f007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079ae7a9-a8cb-4160-870b-e99ad994d115+17:14380:x1874709246491904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.354611:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862513.354660:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb79e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246491904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862513.354676:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf63 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.354685:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdaf63 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862513.354771:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.354804:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862513.354823:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112acb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787862513.354836:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492032 00000100:00100000:2.0:1787862513.354840:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492032 00000100:00100000:2.0:1787862513.354862:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787862513.354869:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a102916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:14380:x1874709246492032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.355146:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a102916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:14380:x1874709246492032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.355154:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787862513.355187:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.355218:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.355256:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862513.355269:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112acb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787862513.355281:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492160 00000100:00100000:2.0:1787862513.355284:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492160 00000100:00100000:2.0:1787862513.355304:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787862513.355310:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:14380:x1874709246492160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.355447:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:14380:x1874709246492160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.355453:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787862513.355489:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787862513.356125:0:16556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787862513.356184:0:14380:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787862513.356198:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862513.356206:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf63 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356216:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13ee8ba00/0x391a6cd368cdaf5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf63 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862513.356225:0:14380:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862513.356228:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a13d89c000 from 10 10000000:01000000:2.0:1787862513.356231:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862513.356258:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356266:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356274:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862513.356291:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.356325:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862513.356341:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112acbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862513.356356:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492288 00000100:00100000:2.0:1787862513.356360:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492288 00000100:00100000:2.0:1787862513.356386:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787862513.356393:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+17:14380:x1874709246492288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862513.356402:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862513.356414:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79f000/0x391a6cd368cdaf71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdaf6a expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356447:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79f000/0x391a6cd368cdaf71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdaf6a expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356457:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79f000/0x391a6cd368cdaf71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdaf6a expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356465:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79f000, rc 0) 00000100:00100000:2.0:1787862513.356497:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246492288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.356503:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787862513.356538:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862513.356551:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf71 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.356558:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdaf71 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862513.356602:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.356630:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862513.356642:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112acbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862513.356652:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492416 00000100:00100000:2.0:1787862513.356655:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492416 00000100:00100000:2.0:1787862513.356675:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787862513.356681:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246492416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.356863:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246492416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.356878:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787862513.356907:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.356946:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.356982:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862513.356995:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a112acbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862513.357006:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492544 00000100:00100000:2.0:1787862513.357010:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492544 00000100:00100000:2.0:1787862513.357029:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787862513.357035:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246492544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.357178:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246492544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.357185:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787862513.357222:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787862513.358101:0:16557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787862513.358161:0:14380:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787862513.358178:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862513.358187:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf71 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358196:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a13d79ee00/0x391a6cd368cdaf6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf71 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862513.358206:0:14380:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787862513.358208:0:14380:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89a104df9800 from 10 10000000:01000000:3.0:1787862513.358211:0:14380:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862513.358240:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358247:0:14380:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358255:0:14380:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862513.358273:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.358321:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862513.358343:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862513.358360:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492672 00000100:00100000:3.0:1787862513.358365:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492672 00000100:00100000:3.0:1787862513.358394:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787862513.358402:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+18:14380:x1874709246492672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862513.358412:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862513.358424:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a104c2dc00/0x391a6cd368cdaf7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x391a6cd368cdaf78 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358457:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a104c2dc00/0x391a6cd368cdaf7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x391a6cd368cdaf78 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358468:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a104c2dc00/0x391a6cd368cdaf7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x391a6cd368cdaf78 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358477:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2dc00, rc 0) 00000100:00100000:3.0:1787862513.358507:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246492672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862513.358514:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787862513.358550:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862513.358563:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf7f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862513.358571:0:14380:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x391a6cd368cdaf7f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862513.358610:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.358635:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862513.358647:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862513.358657:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492800 00000100:00100000:3.0:1787862513.358660:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492800 00000100:00100000:3.0:1787862513.358679:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787862513.358685:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a112eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246492800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.358898:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a112eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246492800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862513.358928:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787862513.358961:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.358986:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.359021:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862513.359034:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862513.359065:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246492928 00000100:00100000:3.0:1787862513.359068:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246492928 00000100:00100000:3.0:1787862513.359088:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787862513.359093:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246492928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.359212:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:14380:x1874709246492928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862513.359219:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787862513.359252:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a141b2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079ae7a9-a8cb-4160-870b-e99ad994d115:14380:1874709246492928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787862513.371635:0:16558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787862513.371856:0:14380:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787862513.371880:0:14380:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862513.371893:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf7f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862513.371905:0:14380:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff89a104c2c400/0x391a6cd368cdaf78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x391a6cd368cdaf7f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862513.489408:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862513.758493:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862513.758543:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223425920 00000100:00100000:2.0:1787862513.758552:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223425920 00000100:00100000:2.0:1787862513.758736:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:2.0:1787862513.758748:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+11:13855:x1874709223425920:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862513.758772:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862513.758791:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a2c expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.758821:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a2c expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.758845:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e400/0x391a6cd368cdaf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a2c expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.758855:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e400, rc 0) 00000100:00100000:2.0:1787862513.758923:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+12:13855:x1874709223425920:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 178us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.758930:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:2.0:1787862513.766592:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862513.766677:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426048 00000100:00100000:0.0:1787862513.766688:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426048 00000100:00100000:0.0:1787862513.766746:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:0.0:1787862513.766757:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+12:13855:x1874709223426048:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862513.767074:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+12:13855:x1874709223426048:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 318us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862513.767082:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:2.0:1787862513.769589:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862513.769619:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426176 00000100:00100000:2.0:1787862513.769627:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426176 00000100:00100000:2.0:1787862513.769817:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:2.0:1787862513.769828:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+12:13855:x1874709223426176:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.770073:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+12:13855:x1874709223426176:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 246us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.770082:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:0.0:1787862513.784202:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862513.792904:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426304 00000100:00100000:2.0:1787862513.792930:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426304 00000100:00100000:2.0:1787862513.792993:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:2.0:1787862513.793004:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+12:13855:x1874709223426304:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862513.793028:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862513.793067:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a13d79e200/0x391a6cd368cdaf8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a33 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.793100:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a13d79e200/0x391a6cd368cdaf8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a33 expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.793134:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a13d79e200/0x391a6cd368cdaf8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a33 expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862513.793146:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79e200, rc 0) 00000100:00100000:2.0:1787862513.793213:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+13:13855:x1874709223426304:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 211us (9024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.793220:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:3.0:1787862513.798390:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862513.798534:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426432 00000100:00100000:2.0:1787862513.798544:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426432 00000100:00100000:2.0:1787862513.798880:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:2.0:1787862513.798890:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+13:13855:x1874709223426432:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862513.799840:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11f775cd-efec-442d-9c84-9e6fe739a736+13:13855:x1874709223426432:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 944us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862513.799853:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:1.0:1787862513.807457:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862513.815155:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426560 00000100:00100000:3.0:1787862513.815173:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426560 00000100:00100000:3.0:1787862513.815896:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:3.0:1787862513.815918:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+13:13855:x1874709223426560:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862513.818849:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:11f775cd-efec-442d-9c84-9e6fe739a736+13:13855:x1874709223426560:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 2929us (11389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862513.818864:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 122 00010000:00010000:1.0:1787862514.500676:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862514.693095:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862514.693120:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246493056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862514.693191:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862514.693853:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493056 00000100:00100000:0.0:1787862514.693861:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493056 00000100:00100000:0.0:1787862514.693939:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862514.693949:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246493056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862514.693984:0:15069:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862514.694067:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246493056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862514.694164:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246493312:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694199:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862514.694225:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862514.694230:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246493184:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694259:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862514.694279:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246493696:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694301:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862514.694329:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493312 00000100:00100000:2.0:1787862514.694333:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493312 00000100:00100000:2.0:1787862514.694362:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862514.694369:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246493312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694410:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246493312:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862514.694416:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862514.694436:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493184 00000100:00100000:2.0:1787862514.694439:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493184 00000100:00100000:2.0:1787862514.694457:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787862514.694463:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3330:x1874709246493184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694490:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3330:x1874709246493184:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862514.694496:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787862514.694543:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493696 00000100:00100000:2.0:1787862514.694546:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493696 00000100:00100000:2.0:1787862514.694575:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787862514.694581:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246493696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694611:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246493696:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862514.694618:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787862514.694653:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079ae7a9-a8cb-4160-870b-e99ad994d115:3330:1874709246493184:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694665:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246493696:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694673:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246493312:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694716:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246493568:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694738:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862514.694755:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862514.694760:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246493440:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694785:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862514.694807:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493568 00000100:00100000:2.0:1787862514.694810:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493568 00000100:00100000:2.0:1787862514.694829:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493440 00000100:00100000:2.0:1787862514.694832:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493440 00000100:00100000:2.0:1787862514.694848:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787862514.694853:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246493568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694884:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3328:x1874709246493568:12345-0@lo:400:kworker.0 Request processed in 30us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862514.694890:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787862514.694913:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787862514.694918:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246493440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694943:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3328:x1874709246493440:12345-0@lo:400:kworker.0 Request processed in 25us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862514.694948:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787862514.694975:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3328:1874709246493440:0@lo:400:kworker.0 00000100:00100000:2.0:1787862514.694983:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3328:1874709246493568:0@lo:400:kworker.0 00000100:00100000:3.0:1787862514.695543:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246493056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862514.695767:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787862514.696963:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862514.696972:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862514.696975:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862515.524856:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862516.005414:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.005647:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426688 00000100:00100000:2.0:1787862516.005657:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426688 00000100:00100000:2.0:1787862516.005781:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1787862516.005793:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:14516:x1874709223426688:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862516.005816:0:15798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.005839:0:15798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cdaf94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a3a expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.005921:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.005948:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.005961:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.005976:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.005983:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.005989:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006530:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdafa9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006551:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdafa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006558:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdafa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.006645:0:15798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787862516.006649:0:15798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862516.006748:0:15798:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdafa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006759:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006774:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006780:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006786:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.006789:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006797:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006809:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:2.0:1787862516.006812:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.006816:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006823:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdaf9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006835:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006841:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006847:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006852:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fa00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.006860:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006867:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006875:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89a1205e1a00) 00010000:00010000:2.0:1787862516.006878:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.006881:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006897:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006932:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cdaf94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a3a expref: 8 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006945:0:15798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fc00/0x391a6cd368cdafa9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a3a expref: 7 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.006952:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89a1205e1600) 00010000:00010000:2.0:1787862516.006954:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862516.006957:0:15798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13d79fc00, rc 0) 00000100:00100000:2.0:1787862516.007030:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:14516:x1874709223426688:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1239us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.007082:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00080000:1.0:1787862516.008680:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862516.018944:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.019283:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223426944 00000100:00100000:2.0:1787862516.019293:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223426944 00000100:00100000:2.0:1787862516.019410:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1787862516.019422:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:14516:x1874709223426944:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862516.019451:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.019472:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cdafb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a41 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.019554:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.019570:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.019581:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.019595:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.019602:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.019608:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020216:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104000/0x391a6cd368cdafc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020226:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104000/0x391a6cd368cdafc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020235:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104000/0x391a6cd368cdafc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.020246:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787862516.020505:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020514:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020521:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020527:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79fa00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.020532:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020539:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020552:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89a1205e1600) 00010000:00010000:2.0:1787862516.020555:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.020561:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020567:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79fa00/0x391a6cd368cdafb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020579:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020584:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020589:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020604:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13d79f200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.020607:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.020614:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.022954:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89a1205e1a00) 00010000:00010000:2.0:1787862516.022966:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.022977:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.022989:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79f200/0x391a6cd368cdafbe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.023594:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13d79ec00/0x391a6cd368cdafb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a41 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.023614:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104000/0x391a6cd368cdafc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a41 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.023622:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:2.0:1787862516.023624:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.023627:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141104000, rc 0) 00000100:00100000:2.0:1787862516.023709:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14516:x1874709223426944:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 4289us (4776us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787862516.023718:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1787862516.027621:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.027878:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427072 00000100:00100000:2.0:1787862516.027914:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427072 00000100:00100000:2.0:1787862516.027978:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:2.0:1787862516.027988:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14516:x1874709223427072:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787862516.028127:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14516:x1874709223427072:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 141us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.028135:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:1.0:1787862516.131316:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862516.131525:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427200 00000100:00100000:0.0:1787862516.131554:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427200 00000100:00100000:0.0:1787862516.131646:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1787862516.131660:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14522:x1874709223427200:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862516.131704:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862516.131741:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a000/0x391a6cd368cdafd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a48 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.131826:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.131845:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.131861:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.131879:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.131897:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.131930:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132788:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132802:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132809:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132816:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8aa00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862516.132822:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132830:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132847:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:0.0:1787862516.132850:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862516.132856:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132862:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdafda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132876:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132893:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132907:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132912:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8a200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862516.132915:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132922:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132931:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89a1136f8c00) 00010000:00010000:0.0:1787862516.132933:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862516.132936:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.132942:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdafe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.133543:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a000/0x391a6cd368cdafd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a48 expref: 10 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.133561:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:0.0:1787862516.133564:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862516.133568:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a000/0x391a6cd368cdafd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a48 expref: 10 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.133578:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8a000, rc 0) 00000100:00100000:0.0:1787862516.133691:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14522:x1874709223427200:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 2033us (2391us total) trans 0 rc 301/301 00000100:00100000:0.0:1787862516.133714:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:3.0:1787862516.143351:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.143587:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427328 00000100:00100000:2.0:1787862516.143600:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427328 00000100:00100000:2.0:1787862516.143678:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1787862516.143690:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14522:x1874709223427328:12345-192.168.202.9@tcp:700:lfs.0 00000100:00100000:2.0:1787862516.143819:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14522:x1874709223427328:12345-192.168.202.9@tcp:700:lfs.0 Request processed in 130us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.143828:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1787862516.153365:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.153568:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427584 00000100:00100000:2.0:1787862516.153582:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427584 00000100:00100000:2.0:1787862516.153677:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1787862516.153691:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14522:x1874709223427584:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:2.0:1787862516.153776:0:15798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862516.154118:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2da00/0x391a6cd368cdaf16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c09c3 expref: 9 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.154145:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:2.0:1787862516.154152:0:15798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862516.154763:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.154863:0:15798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 5 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.154894:0:15798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.154945:0:15798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 5 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.154966:0:15798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 5 pid: 15798 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.154985:0:15798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15798:1874709246493824:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862516.155238:0:15798:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e76e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862516.167127:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.167262:0:15798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15798:1874709246493824:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862516.167318:0:15798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862516.168965:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427712 00000100:00100000:0.0:1787862516.168983:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427712 00010000:00010000:0.0:1787862516.169124:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 6 pid: 15798 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862516.169185:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1787862516.169198:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24424550-2972-414f-9f3f-de7961d3d9cb+6:2353:x1874709223427712:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862516.169420:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862516.169429:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 6 pid: 15798 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.169442:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 6 pid: 15798 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.169468:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2de00/0x391a6cd368cdaf4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a25 expref: 6 pid: 15798 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.169485:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:0.0:1787862516.169490:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.169499:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.169505:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.169562:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787862516.169932:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862516.169971:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24424550-2972-414f-9f3f-de7961d3d9cb+5:2353:x1874709223427712:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 453us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862516.169982:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00010000:00010000:2.0:1787862516.170086:0:15798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.170096:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.170126:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.170137:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.170146:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.180642:0:15798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787862516.180685:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.180699:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.180709:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.180716:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.180722:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.180733:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.180756:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a119282c00) 00010000:00010000:2.0:1787862516.180760:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.180766:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.180772:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdafe8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862516.181083:0:15798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007046f634 reply state 00000000db6637b7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.181096:0:15798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862516.181541:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+10:14522:x1874709223427584:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 27845us (28185us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787862516.181574:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00010000:00010000:3.0:1787862516.194087:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.194113:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.194122:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.194129:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862516.194145:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.194155:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.194181:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89a1205e1a00) 00010000:00010000:3.0:1787862516.194184:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862516.194193:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.194201:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105800/0x391a6cd368cdafef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862516.230849:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246493952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862516.230964:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862516.231957:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246493952 00000100:00100000:0.0:1787862516.231973:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246493952 00000100:00100000:0.0:1787862516.232082:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862516.232093:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246493952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862516.232148:0:15070:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862516.232243:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246493952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862516.232251:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787862516.232515:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246493952:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787862516.233145:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862516.328968:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.330003:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427840 00000100:00100000:2.0:1787862516.330019:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427840 00000100:00100000:0.0:1787862516.331264:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1787862516.331285:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a141b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:14530:x1874709223427840:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:0.0:1787862516.331335:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862516.331372:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdaff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a4f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.331476:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b000/0x391a6cd368cdaffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.331496:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b000/0x391a6cd368cdaffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.331511:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b000/0x391a6cd368cdaffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862516.331617:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787862516.331622:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862516.331704:0:14383:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b000/0x391a6cd368cdaffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.331745:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdaff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a4f expref: 11 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.331769:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b000/0x391a6cd368cdaffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a4f expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.331787:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:0.0:1787862516.331790:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862516.331795:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8b000, rc 0) 00000100:00100000:0.0:1787862516.331906:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a141b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+10:14530:x1874709223427840:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 628us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862516.331915:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:1.0:1787862516.383003:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862516.383099:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223427968 00000100:00100000:0.0:1787862516.383114:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223427968 00000100:00100000:0.0:1787862516.383218:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1787862516.383233:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+5:14531:x1874709223427968:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862516.383268:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862516.383303:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdb004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a56 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.383396:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdb00b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.383435:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdb00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.383451:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdb00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862516.383534:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787862516.383539:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862516.383954:0:14385:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdb00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.383993:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdb004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a56 expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.384022:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a200/0x391a6cd368cdb00b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a56 expref: 6 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.384033:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:0.0:1787862516.384036:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862516.384124:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8a200, rc 0) 00000100:00100000:0.0:1787862516.385125:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+6:14531:x1874709223427968:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1885us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862516.385140:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1787862516.388471:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.388720:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223428096 00000100:00100000:2.0:1787862516.388744:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223428096 00000100:00100000:2.0:1787862516.388828:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:2.0:1787862516.388841:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+6:14531:x1874709223428096:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862516.388875:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.388917:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a5d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389017:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389094:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389111:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389132:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389140:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389146:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.389647:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb027 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391593:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391625:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.391727:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787862516.391732:0:14384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862516.391760:0:14384:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391775:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391781:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391788:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391794:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.391798:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391806:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391821:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:2.0:1787862516.391824:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.391829:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391859:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391878:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391895:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391901:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391906:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.391909:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391915:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391923:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89a1205e1400) 00010000:00010000:2.0:1787862516.391926:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.391929:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391935:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb020 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.391984:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a5d expref: 8 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.392011:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb027 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a5d expref: 7 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.392019:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1300) 00010000:00010000:2.0:1787862516.392021:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862516.392024:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141104e00, rc 0) 00000100:00100000:2.0:1787862516.392141:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+7:14531:x1874709223428096:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 3301us (3685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.392150:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1787862516.398893:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862516.399023:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223428352 00000100:00100000:0.0:1787862516.399086:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223428352 00000100:00100000:0.0:1787862516.399178:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:0.0:1787862516.399190:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+7:14531:x1874709223428352:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862516.399223:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862516.399284:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdb02e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a64 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862516.399467:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787862516.399676:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdb02e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a64 expref: 9 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.399695:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:0.0:1787862516.399698:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862516.399705:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8aa00/0x391a6cd368cdb02e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a64 expref: 9 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.399724:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8aa00, rc 0) 00000100:00100000:0.0:1787862516.399819:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+8:14531:x1874709223428352:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 631us (951us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787862516.399828:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:1.0:1787862516.407203:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.407338:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223428608 00000100:00100000:2.0:1787862516.407359:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223428608 00000100:00100000:2.0:1787862516.408006:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1787862516.408020:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24424550-2972-414f-9f3f-de7961d3d9cb+8:14531:x1874709223428608:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:2.0:1787862516.408135:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862516.408166:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb027 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a5d expref: 8 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.408187:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1300) 00010000:00010000:2.0:1787862516.408197:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862516.408221:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.408236:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.408247:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862516.408589:0:14383:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000050002221 reply state 00000000c07c7642 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.408602:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787862516.408623:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787862516.408771:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24424550-2972-414f-9f3f-de7961d3d9cb+9:14531:x1874709223428608:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 754us (1585us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787862516.408779:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:0.0:1787862516.416743:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862516.416899:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223428864 00000100:00100000:1.0:1787862516.416914:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223428864 00000100:00100000:1.0:1787862516.417004:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:1.0:1787862516.417018:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24424550-2972-414f-9f3f-de7961d3d9cb+9:14531:x1874709223428864:12345-192.168.202.9@tcp:35:lfs.0 00010000:00010000:3.0:1787862516.417579:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.417600:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.417610:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.417619:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862516.417625:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.417634:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.417653:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1400) 00010000:00010000:3.0:1787862516.417657:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787862516.417662:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862516.417669:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104c00/0x391a6cd368cdb03c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862516.420092:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24424550-2972-414f-9f3f-de7961d3d9cb+9:14531:x1874709223428864:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 3062us (3349us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787862516.420110:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:1.0:1787862516.425815:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.425997:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223429120 00000100:00100000:2.0:1787862516.426010:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223429120 00000100:00100000:2.0:1787862516.426438:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:2.0:1787862516.426453:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24424550-2972-414f-9f3f-de7961d3d9cb+9:14531:x1874709223429120:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862516.426490:0:15798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.426521:0:15798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a6b expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.427030:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.427389:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.427406:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.427428:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.427435:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.427470:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.427956:0:15798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787862516.428411:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428423:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428430:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428437:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105c00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.428443:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428452:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428470:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:2.0:1787862516.428473:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.428479:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428486:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb04a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428503:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428524:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428602:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428609:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.428612:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428619:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428627:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89a1205e1300) 00010000:00010000:2.0:1787862516.428630:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.428633:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428638:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb051 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428762:0:15798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb043 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a6b expref: 11 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428778:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:2.0:1787862516.428781:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862516.428786:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a6b expref: 11 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.428813:0:15798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141104e00, rc 0) 00000100:00100000:2.0:1787862516.430644:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24424550-2972-414f-9f3f-de7961d3d9cb+10:14531:x1874709223429120:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 4180us (4829us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787862516.430661:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:0.0:1787862516.435621:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.436159:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223429248 00000100:00100000:2.0:1787862516.436174:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223429248 00000100:00100000:2.0:1787862516.436252:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:2.0:1787862516.436264:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+10:14531:x1874709223429248:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862516.436312:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.436347:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb05f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a72 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.436487:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.436507:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.436523:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.436592:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787862516.436597:0:14384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862516.436627:0:14384:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.436659:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb05f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.436710:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.436720:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1f00) 00010000:00010000:2.0:1787862516.436723:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862516.436728:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105a00, rc 0) 00000100:00100000:2.0:1787862516.438101:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24424550-2972-414f-9f3f-de7961d3d9cb+11:14531:x1874709223429248:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1824us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.438117:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1787862516.443682:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.444023:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223429376 00000100:00100000:2.0:1787862516.444118:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223429376 00000100:00100000:2.0:1787862516.444455:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:2.0:1787862516.444469:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24424550-2972-414f-9f3f-de7961d3d9cb+11:14531:x1874709223429376:12345-192.168.202.9@tcp:37:lfs.0 00000100:00100000:2.0:1787862516.451905:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24424550-2972-414f-9f3f-de7961d3d9cb+11:14531:x1874709223429376:12345-192.168.202.9@tcp:37:lfs.0 Request processed in 7410us (8212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.451924:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:0.0:1787862516.458372:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862516.458492:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223429632 00000100:00100000:1.0:1787862516.458507:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223429632 00000100:00100000:1.0:1787862516.458699:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:1.0:1787862516.458712:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a107e67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24424550-2972-414f-9f3f-de7961d3d9cb+11:14531:x1874709223429632:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1787862516.459138:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a107e67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24424550-2972-414f-9f3f-de7961d3d9cb+12:14531:x1874709223429632:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 419us (895us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787862516.459147:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1787862516.531593:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.531784:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223429760 00000100:00100000:2.0:1787862516.531798:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223429760 00000100:00100000:2.0:1787862516.531902:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:2.0:1787862516.531916:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+10:14537:x1874709223429760:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862516.531948:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.531976:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb06d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a79 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532122:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532174:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532191:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532214:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532221:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532228:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532404:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb082 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532413:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb082 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532420:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb082 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.532460:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787862516.532464:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862516.532522:0:14385:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb082 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532550:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532571:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532578:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532585:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.532590:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532599:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532615:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:2.0:1787862516.532619:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.532626:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532633:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532651:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532657:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532663:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532668:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.532678:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532685:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532693:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89a1205e1300) 00010000:00010000:2.0:1787862516.532696:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.532699:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532704:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb07b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532746:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb06d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a79 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532762:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105c00/0x391a6cd368cdb082 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a79 expref: 11 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.532770:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1f00) 00010000:00010000:2.0:1787862516.532772:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862516.532775:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105c00, rc 0) 00000100:00100000:2.0:1787862516.532866:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+11:14537:x1874709223429760:12345-192.168.202.9@tcp:101:bash.0 Request processed in 954us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.532875:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1787862516.542497:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.542650:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223430016 00000100:00100000:2.0:1787862516.542663:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223430016 00000100:00100000:2.0:1787862516.542760:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1787862516.542772:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+11:14537:x1874709223430016:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862516.542822:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.542854:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb089 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a80 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.543133:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.543153:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.543164:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.543218:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.543234:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 11 pid: 14384 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.543250:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874709246494080:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862516.543371:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862516.547806:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862516.547934:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223430144 00000100:00100000:1.0:1787862516.547947:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223430144 00010000:00010000:1.0:1787862516.548008:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 12 pid: 14384 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862516.548104:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1787862516.548117:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24424550-2972-414f-9f3f-de7961d3d9cb+12:2352:x1874709223430144:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862516.548148:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862516.548159:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 12 pid: 14384 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.548176:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 12 pid: 14384 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.548210:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1f00) 00010000:00010000:1.0:1787862516.548216:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.548229:0:14370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.548239:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.548265:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862516.548346:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24424550-2972-414f-9f3f-de7961d3d9cb+12:2352:x1874709223430144:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 232us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862516.548354:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00010000:00010000:2.0:1787862516.550765:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb066 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a72 expref: 11 pid: 14384 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.550799:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874709246494080:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862516.550844:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.551372:0:14384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.551382:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.551421:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.551441:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.551453:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.551795:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862516.554455:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554487:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554504:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.554522:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787862516.554650:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554661:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554752:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554775:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.554781:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554790:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554808:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1f00) 00010000:00010000:2.0:1787862516.554811:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862516.554818:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.554824:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb090 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862516.554844:0:14384:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d449b15a reply state 000000009564f92c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.554855:0:14384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787862516.554987:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb089 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 14 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.555005:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 13 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.555013:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862516.555015:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787862516.555018:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141104400, rc 0) 00000100:00100000:2.0:1787862516.555351:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:14537:x1874709223430016:12345-192.168.202.9@tcp:101:bash.0 Request processed in 12579us (12867us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787862516.555368:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00010000:00010000:1.0:1787862516.559096:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.559119:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.559136:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.559143:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104e00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862516.559149:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.559159:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.559182:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89a1205e1300) 00010000:00010000:1.0:1787862516.559185:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862516.559192:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.559200:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104e00/0x391a6cd368cdb097 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862516.577849:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.578064:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223430272 00000100:00100000:2.0:1787862516.578077:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223430272 00000100:00100000:2.0:1787862516.578461:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:2.0:1787862516.578476:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+13:14537:x1874709223430272:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1787862516.578517:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.578563:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a87 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578679:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578699:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578714:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.578772:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787862516.578778:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862516.578804:0:14385:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578816:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578846:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 15 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578870:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 14 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.578912:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862516.578915:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862516.578919:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105200, rc 0) 00000100:00100000:2.0:1787862516.579002:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:14537:x1874709223430272:12345-192.168.202.9@tcp:101:bash.0 Request processed in 529us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.579010:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1787862516.585848:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.586119:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223430528 00000100:00100000:2.0:1787862516.586142:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223430528 00000100:00100000:2.0:1787862516.586221:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:2.0:1787862516.586232:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:14537:x1874709223430528:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1787862516.587572:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+15:14537:x1874709223430528:12345-192.168.202.9@tcp:35:bash.0 Request processed in 1328us (1730us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787862516.587588:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1787862516.715089:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862516.715305:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223430784 00000100:00100000:0.0:1787862516.715319:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223430784 00000100:00100000:0.0:1787862516.715404:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:0.0:1787862516.715416:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+15:14547:x1874709223430784:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1787862516.715476:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862516.715505:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb0ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a8e expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862516.715685:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787862516.715864:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb0ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a8e expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.716143:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a1136f8c00) 00010000:00010000:0.0:1787862516.716148:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862516.716154:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb0ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a8e expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862516.716173:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8a400, rc 0) 00000100:00100000:0.0:1787862516.717202:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+16:14547:x1874709223430784:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1775us (2168us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787862516.717217:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:0.0:1787862516.722032:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.722163:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223431040 00000100:00100000:2.0:1787862516.722177:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223431040 00000100:00100000:2.0:1787862516.722274:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1787862516.722287:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+16:14547:x1874709223431040:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862516.722672:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+17:14547:x1874709223431040:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 385us (654us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787862516.722681:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1787862516.772812:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.773628:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223431296 00000100:00100000:2.0:1787862516.773643:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223431296 00000100:00100000:2.0:1787862516.773740:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:2.0:1787862516.773754:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+17:14550:x1874709223431296:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1787862516.773814:0:15798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862516.773846:0:15798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a95 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.774028:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb0cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.774100:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb0cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.774117:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb0cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862516.774133:0:15798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787862516.774331:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a95 expref: 20 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.774355:0:15798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb0cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a95 expref: 19 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.774365:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862516.774368:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862516.774373:0:15798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105a00, rc 0) 00000100:00100000:2.0:1787862516.774455:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14550:x1874709223431296:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 704us (1661us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787862516.774464:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:0.0:1787862516.782175:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862516.782229:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.782383:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223431424 00000100:00100000:2.0:1787862516.782397:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223431424 00000100:00100000:2.0:1787862516.782482:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:2.0:1787862516.782519:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14550:x1874709223431424:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:2.0:1787862516.782645:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782671:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782688:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782726:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782734:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782743:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782749:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862516.782754:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782764:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782779:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862516.782783:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862516.782788:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862516.782795:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862516.782921:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14550:x1874709223431424:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 404us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.782930:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:1.0:1787862516.783591:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223431552 00000100:00100000:1.0:1787862516.783600:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223431552 00000100:00100000:1.0:1787862516.783666:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1787862516.783684:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:2352:x1874709223431552:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862516.783701:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862516.783725:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb0cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a95 expref: 19 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862516.783741:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:1.0:1787862516.783745:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862516.783794:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+18:2352:x1874709223431552:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 112us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862516.783802:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1787862516.789145:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862516.789260:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223431808 00000100:00100000:2.0:1787862516.789283:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223431808 00000100:00100000:2.0:1787862516.789357:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1787862516.789368:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+18:14550:x1874709223431808:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1787862516.789715:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14550:x1874709223431808:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 348us (587us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787862516.789725:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000040:00080000:3.0:1787862516.997355:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787862517.115982:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862517.116179:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223432064 00000100:00100000:2.0:1787862517.116193:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223432064 00000100:00100000:2.0:1787862517.116275:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1787862517.116287:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14581:x1874709223432064:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:2.0:1787862517.116322:0:15798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862517.116352:0:15798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0a9c expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.116490:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb0eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.116507:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.116535:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862517.116573:0:15798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787862517.116780:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb0e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a9c expref: 22 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.116801:0:15798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb0eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a9c expref: 21 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.116811:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862517.116814:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862517.116818:0:15798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105600, rc 0) 00000100:00100000:2.0:1787862517.116914:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:14581:x1874709223432064:12345-192.168.202.9@tcp:101:cat.0 Request processed in 629us (948us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787862517.116922:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:1.0:1787862517.124086:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862517.124202:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862517.124507:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223432448 00000100:00100000:2.0:1787862517.124530:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223432448 00000100:00100000:2.0:1787862517.124612:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1787862517.124625:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:14581:x1874709223432448:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:2.0:1787862517.125140:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+22:14581:x1874709223432448:12345-192.168.202.9@tcp:35:cat.0 Request processed in 502us (1091us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787862517.125149:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1787862517.126082:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223432192 00000100:00100000:3.0:1787862517.126095:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223432192 00000100:00100000:3.0:1787862517.126182:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:3.0:1787862517.126212:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+22:2353:x1874709223432192:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862517.126229:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862517.126263:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb0eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a9c expref: 22 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.126286:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862517.126291:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862517.143380:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:2353:x1874709223432192:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 17150us (19156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862517.143401:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1787862517.204465:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862517.204596:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223432704 00000100:00100000:2.0:1787862517.204611:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223432704 00000100:00100000:2.0:1787862517.204721:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:2.0:1787862517.204735:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:14587:x1874709223432704:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:2.0:1787862517.204771:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862517.204816:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb0f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0aa3 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.204968:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.204988:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.204998:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 22 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.205459:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.205513:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 22 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.205530:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 22 pid: 14385 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862517.205546:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874709246494208:192.168.202.9@tcp:104: 00010000:00010000:2.0:1787862517.207391:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.207415:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862517.207432:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a1086743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874709246494336:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862517.208969:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862517.211287:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862517.211565:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874709246494208:192.168.202.9@tcp:104: 00000100:00100000:0.0:1787862517.211582:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a1086743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874709246494336:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862517.211625:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862517.212780:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223432832 00000100:00100000:2.0:1787862517.212796:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223432832 00010000:00010000:2.0:1787862517.212856:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 23 pid: 14385 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862517.212918:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1787862517.212930:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a0056e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+23:2352:x1874709223432832:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862517.212950:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862517.212959:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 23 pid: 14385 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.212974:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 23 pid: 14385 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.213003:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb0b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a87 expref: 23 pid: 14385 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.213023:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862517.213029:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.213105:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.213115:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862517.213251:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a0056e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+22:2352:x1874709223432832:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 321us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862517.213259:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:1.0:1787862517.230901:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862517.237941:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223432960 00000100:00100000:3.0:1787862517.237962:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223432960 00010000:00010000:3.0:1787862517.238033:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862517.240129:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1787862517.240158:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+22:2352:x1874709223432960:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862517.240186:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862517.240200:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.240219:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.240248:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb09e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0a80 expref: 22 pid: 14384 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.240267:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862517.240272:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.240282:0:14370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.240290:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.240336:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862517.240412:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:2352:x1874709223432960:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 269us (9538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862517.240421:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00010000:00010000:3.0:1787862517.241190:0:14384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.241203:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862517.241230:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787862517.241468:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb0f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0aa3 expref: 22 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.241490:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104a00/0x391a6cd368cdb100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0aa3 expref: 21 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.241499:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862517.241520:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787862517.241538:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141104a00, rc 0) 00000100:00100000:3.0:1787862517.241600:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:14587:x1874709223432704:12345-192.168.202.9@tcp:101:dd.0 Request processed in 36868us (37151us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787862517.241610:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1787862517.251857:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862517.251987:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223433216 00000100:00100000:2.0:1787862517.252001:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223433216 00000100:00100000:2.0:1787862517.252268:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:2.0:1787862517.252298:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+21:14587:x1874709223433216:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:2.0:1787862517.252648:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.252670:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.252685:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862517.252897:0:15798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787862517.252928:0:15798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000833f6833 reply state 00000000f7ad6d40 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862517.253906:0:15798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862517.254374:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14587:x1874709223433216:12345-192.168.202.9@tcp:36:dd.0 Request processed in 2070us (2523us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787862517.254386:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000020:00080000:2.0:1787862517.254396:0:15798:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862517.261249:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.261278:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.261286:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.261293:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862517.261299:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.261308:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.261329:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862517.261333:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862517.261338:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.261344:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb10e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862517.262548:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862517.263075:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223433344 00000100:00100000:2.0:1787862517.263089:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223433344 00000100:00100000:2.0:1787862517.263307:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:2.0:1787862517.263321:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+23:14587:x1874709223433344:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:2.0:1787862517.263352:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862517.263379:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb115 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0aaa expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.263450:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb115 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0aaa expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.263489:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb115 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0aaa expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.263512:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862517.263516:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862517.263520:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105200, rc 0) 00000100:00100000:2.0:1787862517.263652:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14587:x1874709223433344:12345-192.168.202.9@tcp:101:dd.0 Request processed in 333us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862517.263660:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:0.0:1787862517.282365:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862517.282480:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223433600 00000100:00100000:3.0:1787862517.282494:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223433600 00000100:00100000:3.0:1787862517.282597:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1787862517.282629:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14587:x1874709223433600:12345-192.168.202.9@tcp:103:dd.0 00010000:00010000:3.0:1787862517.282650:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862517.282683:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb115 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0aaa expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862517.282707:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862517.282713:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862517.282794:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+23:14587:x1874709223433600:12345-192.168.202.9@tcp:103:dd.0 Request processed in 169us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862517.282803:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:1.0:1787862517.288313:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862517.288473:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223433728 00000100:00100000:0.0:1787862517.288485:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223433728 00000100:00100000:0.0:1787862517.288629:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:0.0:1787862517.288643:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+23:14587:x1874709223433728:12345-192.168.202.9@tcp:58:dd.0 00010000:00010000:0.0:1787862517.288779:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862517.288803:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862517.288820:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862517.298628:0:14385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862517.300194:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787862517.300277:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787862517.300414:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+23:14587:x1874709223433728:12345-192.168.202.9@tcp:58:dd.0 Request processed in 11768us (12112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862517.302863:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862517.303006:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223433856 00000100:00100000:2.0:1787862517.303020:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223433856 00000100:00100000:2.0:1787862517.303129:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:2.0:1787862517.303142:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14587:x1874709223433856:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:2.0:1787862517.303171:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862517.303202:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0ab1 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.303294:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.303307:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 25 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.303332:0:14383:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.303348:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 25 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.303381:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862517.303384:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862517.303390:0:14383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 25 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862517.303398:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105e00, rc 0) 00000100:00100000:2.0:1787862517.303474:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14587:x1874709223433856:12345-192.168.202.9@tcp:101:dd.0 Request processed in 334us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862517.303483:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:0.0:1787862517.304229:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00010000:00010000:0.0:1787862517.575213:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862518.022021:0:14415:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862518.022032:0:14415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862518.022095:0:14415:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787862518.022102:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862518.022243:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13cb7a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14415:1874709246494464:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862518.022373:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103ed23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862518.038096:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.038318:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223433984 00000100:00100000:3.0:1787862518.038330:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223433984 00000100:00100000:3.0:1787862518.038417:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1787862518.038431:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14588:x1874709223433984:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787862518.038577:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14588:x1874709223433984:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 Request processed in 149us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.038588:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00080000:1.0:1787862518.038858:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862518.040014:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13cb7a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14415:1874709246494464:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862518.047651:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.054656:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223434112 00000100:00100000:2.0:1787862518.054680:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223434112 00000100:00100000:2.0:1787862518.054843:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1787862518.054857:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14588:x1874709223434112:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862518.054918:0:15798:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862518.055113:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14588:x1874709223434112:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 258us (7476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.055121:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1787862518.061823:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.061982:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223434240 00000100:00100000:3.0:1787862518.061998:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223434240 00000100:00100000:3.0:1787862518.062119:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1787862518.062132:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14588:x1874709223434240:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787862518.062242:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062264:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062308:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062622:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062656:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062673:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062715:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062724:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.062731:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862518.064713:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862518.064724:0:14384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862518.064766:0:14384:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064785:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064792:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064822:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064828:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862518.064832:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064841:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064861:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:3.0:1787862518.064864:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862518.064879:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064886:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb12a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064905:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064911:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064916:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064919:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862518.064922:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064937:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064945:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff89a119282f00) 00010000:00010000:3.0:1787862518.064947:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862518.064950:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064955:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb131 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064973:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064978:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064985:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064989:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2cc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862518.064992:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.064998:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.065005:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:3.0:1787862518.065007:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862518.065009:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.065024:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb138 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.065234:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14588:x1874709223434240:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 3100us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.065245:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:1.0:1787862518.091241:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862518.091607:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223434496 00000100:00100000:0.0:1787862518.091621:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223434496 00000100:00100000:0.0:1787862518.091703:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:0.0:1787862518.091716:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:14588:x1874709223434496:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862518.091750:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862518.091778:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb13f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0ab8 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.091937:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.091958:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.091971:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862518.091986:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787862518.093434:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.093627:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.093648:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.093654:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8ae00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862518.093658:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.093666:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.093684:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:1.0:1787862518.093687:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862518.093691:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.093697:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8ae00/0x391a6cd368cdb146 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.094243:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb13f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab8 expref: 26 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.094258:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89a1205e1500) 00010000:00010000:1.0:1787862518.094261:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862518.094266:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb13f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab8 expref: 26 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.094280:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a13ee8b600, rc 0) 00000100:00100000:3.0:1787862518.102415:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862518.102634:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14588:x1874709223434496:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 2734us (3225us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787862518.102673:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:0.0:1787862518.104834:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223434752 00000100:00100000:0.0:1787862518.104856:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223434752 00000100:00100000:0.0:1787862518.104983:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1787862518.104998:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223434752:12345-192.168.202.9@tcp:400:kworker.0 00000100:00080000:2.0:1787862518.105132:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862518.105145:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223434752:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 149us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862518.105155:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1787862518.111335:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.111374:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.111415:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.111442:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.111476:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223435264 00000100:00100000:2.0:1787862518.111486:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223435264 00000100:00100000:2.0:1787862518.111542:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223434880 00000100:00100000:2.0:1787862518.111546:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223434880 00000100:00100000:2.0:1787862518.111616:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1787862518.111629:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24424550-2972-414f-9f3f-de7961d3d9cb+5:2355:x1874709223435264:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862518.111630:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223435008 00000100:00100000:0.0:1787862518.111646:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223435008 00000100:00100000:0.0:1787862518.111726:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1787862518.111735:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24424550-2972-414f-9f3f-de7961d3d9cb+5:2355:x1874709223435264:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 105us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862518.111743:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+11:2355:x1874709223435008:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1787862518.111751:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1787862518.111778:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1787862518.111790:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1086752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223434880:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862518.111838:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24424550-2972-414f-9f3f-de7961d3d9cb+11:2355:x1874709223435008:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 100us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862518.111851:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1787862518.111859:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1086752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223434880:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 62us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.111879:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00080000:2.0:1787862518.111917:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862518.111923:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862518.111958:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.111980:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223435136 00000100:00100000:2.0:1787862518.111985:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223435136 00000100:00100000:2.0:1787862518.112023:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:2.0:1787862518.112035:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24424550-2972-414f-9f3f-de7961d3d9cb+5:2355:x1874709223435136:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1787862518.112087:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.112131:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24424550-2972-414f-9f3f-de7961d3d9cb+5:2355:x1874709223435136:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.112142:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00080000:2.0:1787862518.112162:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862518.112174:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223435392 00000100:00100000:2.0:1787862518.112178:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223435392 00000100:00100000:2.0:1787862518.112216:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:2.0:1787862518.112228:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14588:x1874709223435392:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862518.112274:0:15798:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862518.112389:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14588:x1874709223435392:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 166us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.112396:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1787862518.116598:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223434624 00000100:00100000:3.0:1787862518.116618:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223434624 00000100:00100000:3.0:1787862518.116701:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:3.0:1787862518.116713:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:2355:x1874709223434624:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1787862518.116836:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:11f775cd-efec-442d-9c84-9e6fe739a736+13:2355:x1874709223434624:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 125us (5419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.116846:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:1.0:1787862518.117092:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.117178:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223435648 00000100:00100000:3.0:1787862518.117184:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223435648 00000100:00100000:3.0:1787862518.117724:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:3.0:1787862518.117735:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+25:14588:x1874709223435648:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862518.117758:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862518.117790:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb154 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0abf expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862518.123284:0:14385:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1787862518.123306:0:14385:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787862518.123505:0:14385:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787862518.125740:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb15b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.125789:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb15b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.125805:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb15b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.125914:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb154 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0abf expref: 28 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.125941:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb15b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0abf expref: 27 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.125951:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a119282f00) 00010000:00010000:3.0:1787862518.125954:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862518.125959:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2c600, rc 0) 00000100:00100000:3.0:1787862518.126164:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+27:14588:x1874709223435648:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 8430us (9081us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787862518.126175:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1787862518.133422:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.134338:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223435904 00000100:00100000:2.0:1787862518.134355:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223435904 00000100:00100000:2.0:1787862518.134439:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:2.0:1787862518.134450:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+27:14588:x1874709223435904:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862518.134657:0:15798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862518.134706:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c600/0x391a6cd368cdb15b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0abf expref: 27 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.134731:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a119282f00) 00010000:00010000:2.0:1787862518.134744:0:15798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862518.135171:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135192:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135204:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135220:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135227:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135244:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135366:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135373:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135381:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135387:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862518.135392:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135400:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135409:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89a1205e1f00) 00010000:00010000:2.0:1787862518.135412:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862518.135416:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135423:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105400/0x391a6cd368cdb169 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135433:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135439:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135445:0:15798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135455:0:15798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104800 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862518.135458:0:15798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135464:0:15798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135471:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5b9125be (ffff89a1205e1e00) 00010000:00010000:2.0:1787862518.135473:0:15798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862518.135475:0:15798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.135481:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104800/0x391a6cd368cdb170 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5b9125be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862518.135606:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+26:14588:x1874709223435904:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1153us (2197us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862518.135615:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:0.0:1787862518.140944:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.141135:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223436032 00000100:00100000:2.0:1787862518.141149:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223436032 00000100:00100000:2.0:1787862518.141232:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:2.0:1787862518.141245:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+26:14588:x1874709223436032:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862518.141288:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862518.141322:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb177 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0ac6 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.141642:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb17e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.141687:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.141701:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.141833:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105200/0x391a6cd368cdb177 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ac6 expref: 28 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.141855:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104400/0x391a6cd368cdb17e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ac6 expref: 27 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.141873:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:2.0:1787862518.141877:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787862518.141882:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141104400, rc 0) 00000100:00100000:2.0:1787862518.141976:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+27:14588:x1874709223436032:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 733us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.146399:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1787862518.150263:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.151441:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223436288 00000100:00100000:2.0:1787862518.151457:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223436288 00000100:00100000:2.0:1787862518.151549:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:2.0:1787862518.151561:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+27:14588:x1874709223436288:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862518.151677:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.151697:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.151733:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862518.152762:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787862518.152781:0:14383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 569187739482ns, next at 570187735834ns, rc = 0 00000004:00010000:2.0:1787862518.152912:0:14383:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000045b73e03 reply state 000000003a11cf20 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862518.152924:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862518.153106:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+29:14588:x1874709223436288:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1543us (2866us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787862518.153116:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00010000:00010000:1.0:1787862518.158675:0:3313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.158702:0:3313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.158711:0:3313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.158718:0:3313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104200 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:1.0:1787862518.158725:0:3313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.158734:0:3313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.158757:0:3313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:1.0:1787862518.158760:0:3313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862518.158765:0:3313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.158771:0:3313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104200/0x391a6cd368cdb185 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862518.160108:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.160991:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223436416 00000100:00100000:2.0:1787862518.161006:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223436416 00000100:00100000:2.0:1787862518.161114:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1787862518.161127:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+28:14588:x1874709223436416:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862518.161504:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862518.161547:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0acd expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.161640:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 29 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.161658:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 29 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.161682:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:2.0:1787862518.161705:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862518.161711:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105600, rc 0) 00000100:00100000:2.0:1787862518.161797:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+29:14588:x1874709223436416:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 673us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.161805:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:0.0:1787862518.176759:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.176895:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223436544 00000100:00100000:2.0:1787862518.176910:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223436544 00000100:00100000:2.0:1787862518.177004:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1787862518.177017:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2354:x1874709223436544:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787862518.178410:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13cb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2354:x1874709223436544:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 1384us (1656us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787862518.178425:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1787862518.185665:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.185858:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223436800 00000100:00100000:2.0:1787862518.185883:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223436800 00000100:00100000:2.0:1787862518.185962:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1787862518.185975:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+29:14588:x1874709223436800:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862518.188304:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+30:14588:x1874709223436800:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 2302us (2630us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787862518.188322:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1787862518.195776:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.196024:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223437056 00000100:00100000:3.0:1787862518.196078:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223437056 00000100:00100000:3.0:1787862518.196160:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:3.0:1787862518.196172:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+30:14588:x1874709223437056:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862518.196348:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+30:14588:x1874709223437056:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 177us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.196377:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:0.0:1787862518.199314:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.199458:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223437184 00000100:00100000:3.0:1787862518.199471:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223437184 00000100:00100000:3.0:1787862518.199561:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:3.0:1787862518.199572:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+30:14588:x1874709223437184:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862518.199601:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862518.199629:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb193 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0ad4 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.199770:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb19a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.199788:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.199802:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862518.199849:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862518.199883:0:14385:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.199918:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb193 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ad4 expref: 32 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.199943:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb19a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ad4 expref: 31 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.199952:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:3.0:1787862518.199964:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787862518.199970:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2d600, rc 0) 00000100:00100000:3.0:1787862518.200227:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+31:14588:x1874709223437184:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 656us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.200235:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1787862518.206896:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.207094:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223437312 00000100:00100000:2.0:1787862518.207108:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223437312 00000100:00100000:2.0:1787862518.207184:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:2.0:1787862518.207196:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+6:2352:x1874709223437312:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862518.207225:0:15067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862518.207257:0:15067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0adb expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862518.207307:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909df6, blocks: 0x1 00010000:00010000:2.0:1787862518.207346:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=569s v=(0 0) 00010000:00010000:2.0:1787862518.207367:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.207379:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 7 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.207410:0:15067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 7 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.207430:0:15067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a141105200, rc 0) 00000100:00100000:2.0:1787862518.207591:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:2352:x1874709223437312:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 319us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.207601:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:2.0:1787862518.222425:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.222639:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223437568 00000100:00100000:3.0:1787862518.222653:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223437568 00000100:00100000:3.0:1787862518.222751:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:3.0:1787862518.222765:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+31:14588:x1874709223437568:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862518.222936:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+31:14588:x1874709223437568:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 174us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.222946:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1787862518.227795:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.227928:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223437696 00000100:00100000:2.0:1787862518.227941:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223437696 00000100:00100000:2.0:1787862518.228033:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:2.0:1787862518.228090:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d0b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+31:14588:x1874709223437696:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787862518.322802:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1787862518.322832:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:1.0:1787862518.322889:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1787862518.322904:0:5890:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787862518.322913:0:5890:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787862518.323157:0:3328:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862518.323187:0:3328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246494592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787862518.323309:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862518.323550:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d0b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:14588:x1874709223437696:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 95461us (95780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862518.323563:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:3.0:1787862518.325617:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246494592 00000100:00100000:3.0:1787862518.325639:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246494592 00000100:00100000:3.0:1787862518.325740:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787862518.325753:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3328:x1874709246494592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787862518.326083:0:16023:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787862518.326087:0:16023:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787862518.326089:0:16023:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787862518.326092:0:16023:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787862518 -> 1787862518 00002000:00010000:3.0:1787862518.326094:0:16023:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787862518.326202:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3328:x1874709246494592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 452us (2893us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787862518.326211:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787862518.326605:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787862518.332948:0:3328:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a13d7acb40/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787862518.332973:0:3328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3328:1874709246494592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787862518.334814:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862518.335778:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223437824 00000100:00100000:0.0:1787862518.335791:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223437824 00000100:00100000:0.0:1787862518.335857:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1787862518.335881:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:2353:x1874709223437824:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787862518.336070:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:2353:x1874709223437824:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 203us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862518.336079:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1787862518.346830:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.347024:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438080 00000100:00100000:3.0:1787862518.347036:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438080 00000100:00100000:3.0:1787862518.347154:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:3.0:1787862518.347166:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:14588:x1874709223438080:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862518.347239:0:15798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862518.347455:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2d600/0x391a6cd368cdb19a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ad4 expref: 14 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.347484:0:15798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:3.0:1787862518.347490:0:15798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862518.347542:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.347561:0:15798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.347575:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862518.347889:0:15798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ba561cd8 reply state 00000000f3d0d4b9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.347903:0:15798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862518.348106:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+15:14588:x1874709223438080:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 939us (1290us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787862518.348115:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00010000:00010000:3.0:1787862518.355103:0:3314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.355126:0:3314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.355156:0:3314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.355163:0:3314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2cc00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:3.0:1787862518.355169:0:3314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.355178:0:3314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.355199:0:3314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:3.0:1787862518.355203:0:3314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862518.355209:0:3314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.355216:0:3314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2cc00/0x391a6cd368cdb1a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862518.362153:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.363182:0:16023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438208 00000100:00100000:3.0:1787862518.363203:0:16023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438208 00000100:00100000:3.0:1787862518.363302:0:16023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:3.0:1787862518.363314:0:16023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:14588:x1874709223438208:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862518.363339:0:16023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862518.363366:0:16023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf23b73227e9c0ae2 expref: -99 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.363411:0:16023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.363445:0:16023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862518.363450:0:16023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862518.363458:0:16023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 8 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.363505:0:16023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.364223:0:16023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.364245:0:16023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16023:1874709246494720:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862518.364625:0:16023:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862518.369003:0:16023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16023:1874709246494720:192.168.202.9@tcp:104: 00010000:00010000:3.0:1787862518.369096:0:16023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 8 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.369125:0:16023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a104c2cc00, rc 0) 00000100:00100000:3.0:1787862518.369214:0:16023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+8:14588:x1874709223438208:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 5902us (7077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.369225:0:16023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:1.0:1787862518.373221:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862518.373341:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438336 00000100:00100000:0.0:1787862518.373355:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438336 00010000:00010000:0.0:1787862518.373421:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862518.373479:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1787862518.373492:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+8:2353:x1874709223438336:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862518.373540:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862518.373569:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.373584:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.373613:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c5e2ce/0x391a6cd368cdb1a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0adb expref: 8 pid: 15067 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.373635:0:14368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862518.373641:0:14368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862518.373648:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 7 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.373659:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 7 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.373718:0:14368:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 7 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862518.373736:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14368:1874709246494848:192.168.202.9@tcp:105: 00000100:00100000:0.0:1787862518.373848:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a13e203840 going to sleep for 11 seconds 00000100:00100000:1.0:1787862518.389678:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.391006:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438464 00000100:00100000:2.0:1787862518.391024:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438464 00000100:00100000:2.0:1787862518.391167:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1787862518.391181:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+8:2353:x1874709223438464:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787862518.391476:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787862518.391480:0:15067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787862517 00002000:00010000:2.0:1787862518.391483:0:15067:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787862516 00002000:00010000:2.0:1787862518.391486:0:15067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787862518 -> 1787862517 00002000:00010000:2.0:1787862518.391488:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787862518.392159:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:2353:x1874709223438464:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 975us (2493us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787862518.392172:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1787862518.396966:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.397077:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438592 00000100:00100000:3.0:1787862518.397090:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438592 00000100:00100000:3.0:1787862518.397165:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:3.0:1787862518.397196:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:2352:x1874709223438592:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787862518.397428:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.397456:0:15068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 9 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.397467:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862518.397472:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862518.397477:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862518.397812:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcda40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14368:1874709246494848:192.168.202.9@tcp:105: 00010000:00010000:0.0:1787862518.397841:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862518.401592:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:2353:x1874709223438336:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 28081us (28363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862518.401614:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00010000:00010000:2.0:1787862518.407682:0:15068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 8 pid: 16023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.407805:0:15068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 8 pid: 16023 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862518.407830:0:15068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a10871cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15068:1874709246494976:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862518.408103:0:15068:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1067a2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862518.422861:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862518.423122:0:15068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a10871cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15068:1874709246494976:192.168.202.9@tcp:104: 00010000:00010000:0.0:1787862518.423160:0:15068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862518.423339:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438720 00000100:00100000:1.0:1787862518.423348:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438720 00010000:00010000:1.0:1787862518.423408:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 9 pid: 16023 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862518.423527:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1787862518.423539:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+9:2352:x1874709223438720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862518.423560:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862518.423590:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 9 pid: 16023 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.423606:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 9 pid: 16023 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.423654:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db62bf15/0x391a6cd368cdb1af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ae2 expref: 9 pid: 16023 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.423676:0:14370:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862518.423681:0:14370:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862518.423699:0:14370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.423711:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.423748:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862518.423819:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+8:2352:x1874709223438720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 281us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862518.423827:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00010000:00010000:0.0:1787862518.423909:0:15068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.423927:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.423959:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.423969:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.423978:0:15068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.423998:0:15068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2d600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862518.424004:0:15068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.424014:0:15068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.424065:0:15068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.424075:0:15068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b71c6a2/0x391a6cd368cdb1b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862518.424129:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f06987a3-b399-4fd0-8db5-0cc18e603de6+7:2352:x1874709223438592:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 26936us (27180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862518.424138:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1787862518.434011:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.434193:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223438976 00000100:00100000:2.0:1787862518.434206:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223438976 00000100:00100000:2.0:1787862518.434294:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:2.0:1787862518.434306:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:14588:x1874709223438976:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787862518.434423:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.434447:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.434463:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.435485:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.435510:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 15 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.435678:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.435799:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 15 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.435818:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 15 pid: 14384 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862518.435836:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108674000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14383:1874709246495104:192.168.202.9@tcp:104: 00000100:00100000:2.0:1787862518.438276:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a1086379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862518.449821:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862518.449962:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108674000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14383:1874709246495104:192.168.202.9@tcp:104: 00010000:00010000:1.0:1787862518.450001:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.450119:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223439104 00000100:00100000:3.0:1787862518.450127:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223439104 00010000:00010000:3.0:1787862518.450177:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 16 pid: 14384 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.452024:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1787862518.452070:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108677840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+16:2353:x1874709223439104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862518.452103:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862518.452120:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 16 pid: 14384 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.452139:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 16 pid: 14384 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.452172:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105600/0x391a6cd368cdb18c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0acd expref: 16 pid: 14384 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.452217:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:3.0:1787862518.452223:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.452236:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.452244:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.452293:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862518.452372:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108677840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+15:2353:x1874709223439104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 332us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862518.452382:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:2.0:1787862518.452902:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.452915:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862518.453231:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787862518.453427:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787862518.453479:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787862518.453616:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14383:1874709246495232:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787862518.453909:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862518.453978:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862518.454475:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246495232 00000100:00100000:0.0:1787862518.454488:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246495232 00000100:00100000:0.0:1787862518.454562:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862518.454575:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a108674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14383:x1874709246495232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787862518.454707:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a108674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14383:x1874709246495232:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862518.454718:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862518.454766:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14383:1874709246495232:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787862518.455688:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787862518.456201:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a108676940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14383:1874709246495360:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787862518.456289:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862518.456326:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a103e76e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862518.456465:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246495360 00000100:00100000:0.0:1787862518.456472:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246495360 00000100:00100000:0.0:1787862518.456521:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862518.456531:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14383:x1874709246495360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787862518.456715:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14383:x1874709246495360:12345-0@lo:1000:mdt00_000.0 Request processed in 184us (425us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787862518.456723:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862518.456814:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a108676940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14383:1874709246495360:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787862518.456850:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.456870:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.456880:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.456886:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105a00 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862518.456890:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.456898:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.456915:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:2.0:1787862518.456918:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862518.456923:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.456929:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105a00/0x391a6cd368cdb1c4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457237:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457245:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457252:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457258:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8a400 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:2.0:1787862518.457261:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457267:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457278:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:2.0:1787862518.457281:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862518.457288:0:14383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457301:0:14383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457311:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.457364:0:14383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a141105e00/0x391a6cd368cdb123 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xf23b73227e9c0ab1 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862518.457392:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a006a961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14383:1874709246495488:192.168.202.9@tcp:105: 00000100:00100000:2.0:1787862518.457520:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff89a108637900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862518.462004:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862518.462164:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223439232 00000100:00100000:1.0:1787862518.462174:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223439232 00000100:00100000:1.0:1787862518.462234:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1787862518.462243:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a107e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14587:x1874709223439232:12345-192.168.202.9@tcp:49:dd.0 00000100:00100000:1.0:1787862518.462411:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a107e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+19:14587:x1874709223439232:12345-192.168.202.9@tcp:49:dd.0 Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862518.462444:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1787862518.471610:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a006a961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14383:1874709246495488:192.168.202.9@tcp:105: 00010000:00010000:0.0:1787862518.471660:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471671:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8a400/0x391a6cd368cdb11c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471706:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471720:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471730:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471741:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471747:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471753:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471759:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862518.471762:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471768:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471779:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:0.0:1787862518.471782:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862518.471792:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471798:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a13ee8b600/0x391a6cd368cdb1cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471807:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471813:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471819:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471824:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104600 already unused, calling callback (ffffffffc20494f0) 00010000:00010000:0.0:1787862518.471827:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471832:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471840:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89a1205e1c00) 00010000:00010000:0.0:1787862518.471843:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787862518.471845:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.471851:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a141104600/0x391a6cd368cdb1bd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862518.478872:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+18:14588:x1874709223438976:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 44544us (44854us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787862518.478887:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000020:00080000:1.0:1787862518.478894:0:14383:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787862518.486137:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.486236:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223439488 00000100:00100000:3.0:1787862518.486251:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223439488 00000100:00100000:3.0:1787862518.486321:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1787862518.486333:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a006a961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+18:14588:x1874709223439488:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787862518.487255:0:14386:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787862518.487379:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787862518.487439:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487461:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487476:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487499:0:14386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487505:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487511:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487532:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787862518.487654:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a006a961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f06987a3-b399-4fd0-8db5-0cc18e603de6+20:14588:x1874709223439488:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 1320us (1530us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787862518.487666:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000020:00080000:3.0:1787862518.487673:0:14386:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862518.487707:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862518.487714:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487722:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c000 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862518.487727:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487735:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487751:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89a1205e1000) 00010000:00010000:3.0:1787862518.487754:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862518.487761:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487779:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a104c2c000/0x391a6cd368cdb1d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.487793:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862518.487794:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862518.487796:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862518.493092:0:14415:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862518.493333:0:14415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862518.493434:0:14415:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787862518.493447:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862518.596601:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862518.738343:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.738430:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862518.739113:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223439744 00000100:00100000:0.0:1787862518.739132:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223439744 00000100:00100000:0.0:1787862518.739239:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223439616 00000100:00100000:0.0:1787862518.739243:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223439616 00000100:00100000:0.0:1787862518.739270:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1787862518.739281:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1137a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+8:2354:x1874709223439744:12345-192.168.202.9@tcp:4:dd.0 00002000:00010000:0.0:1787862518.739351:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a909df5, atime: 0x6a909df4, ctime: 0x6a909df5, blocks: 0x1 00010000:00010000:0.0:1787862518.739364:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.739389:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1787862518.739395:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862518.739404:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862518.739422:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.742771:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.742817:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1787862518.742893:0:15071:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787862518.742905:0:15071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787862518.742933:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787862518.742964:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223440000 00000100:00100000:2.0:1787862518.742976:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223440000 00000100:00100000:2.0:1787862518.743108:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787862518.743114:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223439872 00000100:00100000:2.0:1787862518.743117:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223439872 00000100:00100000:2.0:1787862518.748333:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1787862518.748572:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787862518.748589:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223440128 00000100:00100000:3.0:1787862518.748600:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223440128 00000100:00100000:2.0:1787862518.755691:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:2.0:1787862518.755712:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+12:2354:x1874709223439616:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:2.0:1787862518.755763:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.755783:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.755788:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.755794:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.755809:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862518.786466:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1787862518.786662:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.791235:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787862518.792130:0:15071:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787862518.792232:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1787862518.792390:0:15073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787862518.793003:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223440256 00000100:00100000:2.0:1787862518.793014:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223440256 00000100:00100000:3.0:1787862518.794501:0:16614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223440384 00000100:00100000:3.0:1787862518.794515:0:16614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223440384 00000100:00100000:3.0:1787862518.794666:0:16614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1787862518.794678:0:16614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f06987a3-b399-4fd0-8db5-0cc18e603de6+15:2354:x1874709223440000:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:3.0:1787862518.794715:0:16614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.794733:0:16614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862518.794737:0:16614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862518.794744:0:16614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862518.794758:0:16614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862518.799450:0:15071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1787862518.804397:0:16615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:2.0:1787862518.804427:0:16615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f06987a3-b399-4fd0-8db5-0cc18e603de6+16:2354:x1874709223439872:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:2.0:1787862518.804482:0:16615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.804501:0:16615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.804506:0:16615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.804524:0:16615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.804540:0:16615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862518.811441:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:3.0:1787862518.811459:0:15073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:0.0:1787862518.820356:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709223440512 00000100:00100000:0.0:1787862518.820372:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709223440512 00000100:00100000:2.0:1787862518.825227:0:16616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1787862518.825251:0:16616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f06987a3-b399-4fd0-8db5-0cc18e603de6+20:2355:x1874709223440128:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:2.0:1787862518.826531:0:16616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.826609:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.826615:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862518.826623:0:16616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862518.826640:0:16616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862518.929472:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1787862518.929506:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1787862518.929826:0:15072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:1.0:1787862518.929831:0:15072:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787862517 -> 1787862519 00002000:00010000:1.0:1787862518.929834:0:15072:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787862517 -> 1787862519 00002000:00010000:1.0:1787862518.929837:0:15072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1787862518.929853:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.929876:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.929885:0:15072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.929893:0:15072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a13ee8b600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862518.930238:0:15072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.930250:0:15072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.930272:0:15072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.930280:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b606ad14/0x391a6cd368cdb1d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862518.930453:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1137a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+24:2354:x1874709223439744:12345-192.168.202.9@tcp:4:dd.0 Request processed in 191168us (192123us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787862518.930464:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1787862518.930500:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1787862518.930512:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+23:2355:x1874709223440384:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:1.0:1787862518.930545:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.930559:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862518.930563:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862518.930570:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862518.930582:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862519.009026:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1787862519.009378:0:16613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:2.0:1787862519.009383:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 10247 00010000:00010000:2.0:1787862519.009400:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009414:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009422:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009430:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104e00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862519.009435:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009445:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009468:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009475:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb271ebe/0x391a6cd368cdb1e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862519.009742:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+17:2354:x1874709223439616:12345-192.168.202.9@tcp:4:dd.0 Request processed in 254034us (271307us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787862519.009771:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:2.0:1787862519.009811:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1787862519.009824:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+16:2355:x1874709223440256:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:2.0:1787862519.009868:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009883:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787862519.009888:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862519.009896:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.009920:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010283:0:16614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010293:0:16614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010301:0:16614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010307:0:16614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a104c2c800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862519.010311:0:16614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010330:0:16614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010341:0:16614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010348:0:16614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e576a2/0x391a6cd368cdb1e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862519.010383:0:16614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f06987a3-b399-4fd0-8db5-0cc18e603de6+16:2354:x1874709223440000:12345-192.168.202.9@tcp:4:dd.0 Request processed in 215708us (267622us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787862519.010390:0:16614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1787862519.010409:0:16614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1787862519.010417:0:16614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a005bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f06987a3-b399-4fd0-8db5-0cc18e603de6+15:2355:x1874709223440512:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:2.0:1787862519.010435:0:16614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010444:0:16614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862519.010448:0:16614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862519.010452:0:16614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010461:0:16614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010910:0:16616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010920:0:16616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010929:0:16616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010935:0:16616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104c00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:2.0:1787862519.010937:0:16616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010944:0:16616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010954:0:16616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.010961:0:16616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea453bb5/0x391a6cd368cdb1f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011185:0:16615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011195:0:16615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011214:0:16615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011220:0:16615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862519.011223:0:16615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011230:0:16615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011242:0:16615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.011249:0:16615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1ffe3de/0x391a6cd368cdb1ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862519.011288:0:16615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f06987a3-b399-4fd0-8db5-0cc18e603de6+14:2354:x1874709223439872:12345-192.168.202.9@tcp:4:dd.0 Request processed in 206874us (268468us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787862519.011295:0:16615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:2.0:1787862519.011363:0:16616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f06987a3-b399-4fd0-8db5-0cc18e603de6+13:2355:x1874709223440128:12345-192.168.202.9@tcp:4:dd.0 Request processed in 186121us (263041us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787862519.011370:0:16616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000001:00080000:3.0:1787862519.068513:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1787862519.076407:0:15072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1787862519.076417:0:15072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:3.0:1787862519.076433:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.076449:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.076458:0:15072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.076465:0:15072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a1206a9800 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:3.0:1787862519.076470:0:15072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.076478:0:15072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.076499:0:15072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.076519:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f81469/0x391a6cd368cdb1fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862519.081421:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f06987a3-b399-4fd0-8db5-0cc18e603de6+13:2355:x1874709223440384:12345-192.168.202.9@tcp:4:dd.0 Request processed in 150457us (294407us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787862519.081451:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000001:00080000:3.0:1787862519.114970:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1787862519.115105:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862519.115122:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862519.115131:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862519.115139:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141104600 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:1.0:1787862519.115144:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862519.115154:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862519.115175:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862519.115183:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000856e408b/0x391a6cd368cdb203 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862519.115281:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f06987a3-b399-4fd0-8db5-0cc18e603de6+11:2355:x1874709223440256:12345-192.168.202.9@tcp:4:dd.0 Request processed in 105456us (328822us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787862519.115292:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00010000:00010000:0.0:1787862519.117088:0:16614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.117107:0:16614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.117131:0:16614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.117138:0:16614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a141105a00 already unused, calling callback (ffffffffc15f5540) 00010000:00010000:0.0:1787862519.117142:0:16614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.117152:0:16614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.117169:0:16614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862519.117176:0:16614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a740265f/0x391a6cd368cdb20a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862519.117264:0:16614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a005bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f06987a3-b399-4fd0-8db5-0cc18e603de6+5:2355:x1874709223440512:12345-192.168.202.9@tcp:4:dd.0 Request processed in 106843us (325032us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787862519.117274:0:16614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00010000:00010000:3.0:1787862519.622910:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862519.812766:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246496000:0@lo:400:kworker.0 00000100:00100000:0.0:1787862519.812929:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862519.812979:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246495872:0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813012:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862519.813071:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787862519.813078:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246495744:0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813102:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862519.813119:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c103c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246496256:0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813140:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862519.813171:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246496000 00000100:00100000:0.0:1787862519.813178:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787862519.813179:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246496000 00000100:00100000:0.0:1787862519.813185:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246495616:0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813218:0:15798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246496256 00000100:00100000:3.0:1787862519.813222:0:15798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246496256 00000100:00100000:0.0:1787862519.813233:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862519.813252:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862519.813261:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c101e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246496000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813323:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c101e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874709246496000:12345-0@lo:400:kworker.0 Request processed in 62us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.813330:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862519.813346:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862519.813353:0:15798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246496256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862519.813376:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246496128:0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813382:0:15798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874709246496256:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.813388:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862519.813409:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246495616 00000100:00100000:0.0:1787862519.813411:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862519.813412:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246495616 00000100:00100000:3.0:1787862519.813442:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787862519.813443:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874709246496000:0@lo:400:kworker.0 00000100:00100000:0.0:1787862519.813471:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246496128 00000100:00100000:0.0:1787862519.813474:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246496128 00000100:00100000:0.0:1787862519.813500:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787862519.813506:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13c100780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246496128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862519.813511:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246495616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862519.813540:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13c100780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874709246496128:12345-0@lo:400:kworker.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862519.813547:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787862519.813608:0:3329:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862519.813611:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246495872 00000100:00100000:2.0:1787862519.813615:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246495872 00000100:00100000:1.0:1787862519.813617:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13d7afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246496384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862519.813643:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246495744 00000100:00100000:1.0:1787862519.813645:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862519.813646:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246495744 00000100:00100000:2.0:1787862519.813664:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862519.813671:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246495872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862519.813673:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787862519.813679:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a10871ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246495744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862519.813702:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246495872:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862519.813702:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a10871ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874709246495744:12345-0@lo:400:kworker.0 Request processed in 23us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862519.813708:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862519.813716:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787862519.813724:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862519.813728:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862519.813739:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246496384 00000100:00100000:1.0:1787862519.813743:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246496384 00000100:00100000:2.0:1787862519.813752:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787862519.813757:0:3330:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a13d7acb40, transno 8589934595 00000100:00100000:1.0:1787862519.813766:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1787862519.813767:0:3330:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787862519.813771:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a13d7ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246496384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862519.813783:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246495744:0@lo:400:kworker.0 00000100:00100000:2.0:1787862519.813793:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c103c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3330:1874709246496256:0@lo:400:kworker.0 00002000:00000024:1.0:1787862519.813794:0:15070:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862519.813800:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3330:1874709246495872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862519.813828:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d7ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3329:x1874709246496384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862519.813834:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787862519.814199:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13d7afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3329:1874709246496384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862519.814810:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a13d78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079ae7a9-a8cb-4160-870b-e99ad994d115+19:3327:x1874709246495616:12345-0@lo:400:kworker.0 Request processed in 1326us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.814818:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787862519.816267:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079ae7a9-a8cb-4160-870b-e99ad994d115:3327:1874709246495616:0@lo:400:kworker.0 00000100:00100000:0.0:1787862519.816286:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a005bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3327:1874709246496128:0@lo:400:kworker.0 00010000:00010000:0.0:1787862520.645194:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862521.036737:0:16653:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1787862521.348620:0:3327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89a13c102940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246496512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862521.348733:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862521.348949:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709246496512 00000100:00100000:1.0:1787862521.348961:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709246496512 00000100:00100000:1.0:1787862521.349105:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862521.349118:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a1204bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246496512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862521.349173:0:15070:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787862521.349238:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a1204bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874709246496512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862521.349266:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862521.349498:0:3327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89a13c102940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3327:1874709246496512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787862521.349795:0:14379:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862521.668478:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862522.692366:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30452 lines, 30452 kept, 0 dropped, 0 bad.